2025-12-05 17:00:07 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 17:00:07 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 17:00:07 [auto1.fr] INFO: Starting spider auto1.fr
2025-12-05 17:00:07 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 17:00:07 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 17:00:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 17:00:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 17:00:07 [scrapy.extensions.telnet] INFO: Telnet Password: dca34f8092c9e672
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2025-12-05 17:00:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_31_2025-12-05T17_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2025-12-05 17:00:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 17:00:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 17:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 17:00:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 17:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 17:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 17:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 17:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 17:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 17:00:07 [scrapy.core.engine] INFO: Spider opened
2025-12-05 17:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 17:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-05 17:00:07 [scrapy-playwright] INFO: Starting download handler
2025-12-05 17:00:07 [scrapy-playwright] INFO: Starting download handler
2025-12-05 17:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2025-12-05 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2025-12-05 17:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2025-12-05 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2025-12-05 17:00:17 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: DU20610
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU20610%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for DU20610: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: HX28800
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX28800%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for HX28800: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: GU12273
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU12273%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for GU12273: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: EE20104
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE20104%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for EE20104: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: VL42264
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL42264%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for VL42264: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: UN96644
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN96644%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for UN96644: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: NS76335
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS76335%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for NS76335: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: LG54923
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG54923%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for LG54923: 2
2025-12-05 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: LE91136
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE91136%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for LE91136: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: VL02034
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL02034%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for VL02034: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: WM81736
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM81736%27 HTTP/1.1" 200 None
2025-12-05 17:00:17 [auto1.fr] INFO: Scrape type for WM81736: 0
2025-12-05 17:00:17 [auto1.fr] INFO: Found listing with ID: JB80655
2025-12-05 17:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB80655%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for JB80655: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: SX46986
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX46986%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for SX46986: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: LK46272
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK46272%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for LK46272: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: SS40547
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS40547%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for SS40547: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: DM36424
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM36424%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for DM36424: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: XL18055
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL18055%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for XL18055: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: PJ39237
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ39237%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for PJ39237: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: KB91319
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB91319%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for KB91319: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: YH43717
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH43717%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for YH43717: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: PD10730
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD10730%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for PD10730: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: DC62751
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC62751%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for DC62751: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: NK31265
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK31265%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for NK31265: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: MT68726
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT68726%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for MT68726: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: BW61190
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW61190%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for BW61190: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: FV27704
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV27704%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for FV27704: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: RM15097
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM15097%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for RM15097: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: AL08767
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL08767%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for AL08767: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: EL38935
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL38935%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for EL38935: 2
2025-12-05 17:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: HE95031
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE95031%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for HE95031: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: RP55900
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP55900%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for RP55900: 2
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: ZH66059
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH66059%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for ZH66059: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: SC36281
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC36281%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for SC36281: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: GW44733
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW44733%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for GW44733: 2
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: PB91713
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB91713%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for PB91713: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: MT93014
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT93014%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for MT93014: 2
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: RR57688
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR57688%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for RR57688: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: SF02190
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF02190%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for SF02190: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: DW12399
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW12399%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for DW12399: 0
2025-12-05 17:00:18 [auto1.fr] INFO: Found listing with ID: JG66884
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG66884%27 HTTP/1.1" 200 None
2025-12-05 17:00:18 [auto1.fr] INFO: Scrape type for JG66884: 2
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ39237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK31265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT68726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB91319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH43717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG54923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:19 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: DU20610
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU20610%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for DU20610: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: HX28800
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX28800%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for HX28800: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: GU12273
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU12273%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for GU12273: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: EE20104
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE20104%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for EE20104: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: VL42264
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL42264%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for VL42264: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: UN96644
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN96644%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for UN96644: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: NS76335
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS76335%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for NS76335: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: LG54923
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG54923%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for LG54923: 2
2025-12-05 17:00:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/LG54923/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: LE91136
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE91136%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for LE91136: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: VL02034
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL02034%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for VL02034: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: WM81736
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM81736%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for WM81736: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: JB80655
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB80655%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for JB80655: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: SX46986
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX46986%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for SX46986: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: LK46272
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK46272%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for LK46272: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: SS40547
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS40547%27 HTTP/1.1" 200 None
2025-12-05 17:00:19 [auto1.fr] INFO: Scrape type for SS40547: 0
2025-12-05 17:00:19 [auto1.fr] INFO: Found listing with ID: DM36424
2025-12-05 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM36424%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for DM36424: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: XL18055
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL18055%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for XL18055: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: PJ39237
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ39237%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for PJ39237: 2
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: KB91319
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB91319%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for KB91319: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP55900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW44733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: YH43717
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH43717%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for YH43717: 2
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: PD10730
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD10730%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for PD10730: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: DC62751
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC62751%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for DC62751: 2
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: NK31265
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK31265%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for NK31265: 2
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: MT68726
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT68726%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for MT68726: 2
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: BW61190
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW61190%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for BW61190: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: FV27704
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV27704%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for FV27704: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: RM15097
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM15097%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for RM15097: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: AL08767
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL08767%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for AL08767: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: EL38935
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL38935%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for EL38935: 2
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: HE95031
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE95031%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for HE95031: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: RP55900
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP55900%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for RP55900: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL38935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC62751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: ZH66059
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH66059%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for ZH66059: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: SC36281
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC36281%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for SC36281: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: GW44733
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW44733%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for GW44733: 2
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: PB91713
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB91713%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for PB91713: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: MT93014
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT93014%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for MT93014: 2
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: RR57688
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR57688%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for RR57688: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: SF02190
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF02190%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for SF02190: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: DW12399
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW12399%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for DW12399: 0
2025-12-05 17:00:20 [auto1.fr] INFO: Found listing with ID: JG66884
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG66884%27 HTTP/1.1" 200 None
2025-12-05 17:00:20 [auto1.fr] INFO: Scrape type for JG66884: 2
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT93014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG66884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK31265> (referer: https://www.auto1.com/v1/car-details-view/NK31265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0737432a-4bc4-5d35-b7f8-2b98b6d147e0 with identifier: NK31265
2025-12-05 17:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0737432a-4bc4-5d35-b7f8-2b98b6d147e0 with scrape type 2
2025-12-05 17:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0737432a-4bc4-5d35-b7f8-2b98b6d147e0 with scrape type 2
2025-12-05 17:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0737432a-4bc4-5d35-b7f8-2b98b6d147e0, identifier: NK31265
2025-12-05 17:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0737432a-4bc4-5d35-b7f8-2b98b6d147e0 with identifier: NK31265
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2025-12-05 17:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2025-12-05 17:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0737432a-4bc4-5d35-b7f8-2b98b6d147e0 with identifier: NK31265
2025-12-05 17:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0737432a-4bc4-5d35-b7f8-2b98b6d147e0 with identifier: NK31265 to the API
2025-12-05 17:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK31265>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:37:05Z',
'fuel_type': 'diesel',
'id': '0737432a-4bc4-5d35-b7f8-2b98b6d147e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK31265',
'listing': 'auction',
'location': 'FR',
'make': 'Volvo',
'model': 'XC40',
'odometer': 114472,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 2.0 D3 Inscription 2WD',
'transmission': 'automatic',
'trim': 'Inscription 2WD',
'year': 2019}
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK31265%27 HTTP/1.1" 200 None
2025-12-05 17:00:22 [auto1.fr] INFO: Saving data for NK31265: {'auction_closing_time': 1765039025.0, 'created_time': 1764695182.415005, 'last_price_update_time': 1764954022.298501}
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK31265') HTTP/1.1" 204 0
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH43717> (referer: https://www.auto1.com/v1/car-details-view/YH43717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB91319> (referer: https://www.auto1.com/v1/car-details-view/KB91319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ39237> (referer: https://www.auto1.com/v1/car-details-view/PJ39237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG54923> (referer: https://www.auto1.com/v1/car-details-view/LG54923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW44733> (referer: https://www.auto1.com/v1/car-details-view/GW44733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e2d890a-c091-5da7-923f-f74047ab14f9 with identifier: YH43717
2025-12-05 17:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2d890a-c091-5da7-923f-f74047ab14f9 with scrape type 2
2025-12-05 17:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e2d890a-c091-5da7-923f-f74047ab14f9 with scrape type 2
2025-12-05 17:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1e2d890a-c091-5da7-923f-f74047ab14f9, identifier: YH43717
2025-12-05 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1e2d890a-c091-5da7-923f-f74047ab14f9 with identifier: YH43717
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2025-12-05 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2025-12-05 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1e2d890a-c091-5da7-923f-f74047ab14f9 with identifier: YH43717
2025-12-05 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 91935, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh43717', 'expiration_date': '2025-12-06t16:15:07z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '1e2d890a-c091-5da7-923f-f74047ab14f9', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 91935}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:15:07z',
'fuel_type': 'petrol',
'id': '1e2d890a-c091-5da7-923f-f74047ab14f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh43717',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 91935,
'odometer_in_km': 91935,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
2025-12-05 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1e2d890a-c091-5da7-923f-f74047ab14f9 spider: auto1.fr
2025-12-05 17:00:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1e2d890a-c091-5da7-923f-f74047ab14f9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 91935, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh43717', 'expiration_date': '2025-12-06t16:15:07z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '1e2d890a-c091-5da7-923f-f74047ab14f9', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 91935}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:15:07z',
'fuel_type': 'petrol',
'id': '1e2d890a-c091-5da7-923f-f74047ab14f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh43717',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 91935,
'odometer_in_km': 91935,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:15:07Z',
'fuel_type': 'petrol',
'id': '1e2d890a-c091-5da7-923f-f74047ab14f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH43717',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Peugeot',
'model': '208',
'odometer': 91935,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH43717%27 HTTP/1.1" 200 None
2025-12-05 17:00:23 [auto1.fr] INFO: Saving data for YH43717: {'auction_closing_time': 1765037707.0, 'created_time': 1762278051.382793, 'last_price_update_time': 1764954023.153066}
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH43717') HTTP/1.1" 204 0
2025-12-05 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f96f519-0a2d-5ea9-8d9d-2648cc059f26 with identifier: KB91319
2025-12-05 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f96f519-0a2d-5ea9-8d9d-2648cc059f26 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f96f519-0a2d-5ea9-8d9d-2648cc059f26 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2f96f519-0a2d-5ea9-8d9d-2648cc059f26, identifier: KB91319
2025-12-05 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4701b9f3-5b8b-58a0-9551-acf353de0e4a with identifier: PJ39237
2025-12-05 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4701b9f3-5b8b-58a0-9551-acf353de0e4a with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4701b9f3-5b8b-58a0-9551-acf353de0e4a with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4701b9f3-5b8b-58a0-9551-acf353de0e4a, identifier: PJ39237
2025-12-05 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0d593f-6589-5a26-8b66-208fb68a4f06 with identifier: LG54923
2025-12-05 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0d593f-6589-5a26-8b66-208fb68a4f06 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0d593f-6589-5a26-8b66-208fb68a4f06 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe0d593f-6589-5a26-8b66-208fb68a4f06, identifier: LG54923
2025-12-05 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45886669-0311-5cd9-a2aa-35cc969cfc22 with identifier: GW44733
2025-12-05 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45886669-0311-5cd9-a2aa-35cc969cfc22 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45886669-0311-5cd9-a2aa-35cc969cfc22 with scrape type 2
2025-12-05 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 45886669-0311-5cd9-a2aa-35cc969cfc22, identifier: GW44733
2025-12-05 17:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2f96f519-0a2d-5ea9-8d9d-2648cc059f26 with identifier: KB91319
2025-12-05 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2f96f519-0a2d-5ea9-8d9d-2648cc059f26 with identifier: KB91319
2025-12-05 17:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2f96f519-0a2d-5ea9-8d9d-2648cc059f26 with identifier: KB91319 to the API
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB91319>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:23:03Z',
'fuel_type': 'petrol',
'id': '2f96f519-0a2d-5ea9-8d9d-2648cc059f26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB91319',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 70734,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB91319%27 HTTP/1.1" 200 None
2025-12-05 17:00:24 [auto1.fr] INFO: Saving data for KB91319: {'auction_closing_time': 1765038183.0, 'created_time': 1762794765.977301, 'last_price_update_time': 1764954024.057072}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB91319') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4701b9f3-5b8b-58a0-9551-acf353de0e4a with identifier: PJ39237
2025-12-05 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4701b9f3-5b8b-58a0-9551-acf353de0e4a with identifier: PJ39237
2025-12-05 17:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4701b9f3-5b8b-58a0-9551-acf353de0e4a with identifier: PJ39237 to the API
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ39237>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': 'Rental',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 158,
'expiration_date': '2025-12-06T16:55:25Z',
'fuel_type': 'petrol',
'id': '4701b9f3-5b8b-58a0-9551-acf353de0e4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ39237',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Renault',
'model': 'Arkana',
'odometer': 44678,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.3 TCe R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2022}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ39237%27 HTTP/1.1" 200 None
2025-12-05 17:00:24 [auto1.fr] INFO: Saving data for PJ39237: {'auction_closing_time': 1765040125.0, 'created_time': 1764842587.003429, 'last_price_update_time': 1764954024.393148}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ39237') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe0d593f-6589-5a26-8b66-208fb68a4f06 with identifier: LG54923
2025-12-05 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe0d593f-6589-5a26-8b66-208fb68a4f06 with identifier: LG54923
2025-12-05 17:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fe0d593f-6589-5a26-8b66-208fb68a4f06 with identifier: LG54923 to the API
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG54923>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:16:49Z',
'fuel_type': 'diesel',
'id': 'fe0d593f-6589-5a26-8b66-208fb68a4f06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG54923',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 86332,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Sensation',
'transmission': 'automatic',
'trim': 'Sensation',
'year': 2017}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG54923%27 HTTP/1.1" 200 None
2025-12-05 17:00:24 [auto1.fr] INFO: Saving data for LG54923: {'auction_closing_time': 1765037809.0, 'created_time': 1764842669.079667, 'last_price_update_time': 1764954024.72337}
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LG54923') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 45886669-0311-5cd9-a2aa-35cc969cfc22 with identifier: GW44733
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2025-12-05 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 45886669-0311-5cd9-a2aa-35cc969cfc22 with identifier: GW44733
2025-12-05 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162350 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162350
2025-12-05 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 45886669-0311-5cd9-a2aa-35cc969cfc22 spider: auto1.fr
2025-12-05 17:00:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 45886669-0311-5cd9-a2aa-35cc969cfc22 due to rule: high_mileage_for_country.json, error: 162350 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162350
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:02:32Z',
'fuel_type': 'diesel',
'id': '45886669-0311-5cd9-a2aa-35cc969cfc22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW44733',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 162350,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition BlueMotion',
'transmission': 'manual',
'trim': 'Carat Edition BlueMotion',
'year': 2017}
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW44733%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Saving data for GW44733: {'auction_closing_time': 1765036952.0, 'created_time': 1764223425.211183, 'last_price_update_time': 1764954025.066282}
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GW44733') HTTP/1.1" 204 0
2025-12-05 17:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT68726> (referer: https://www.auto1.com/v1/car-details-view/MT68726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:25 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: KH58146
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH58146%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for KH58146: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: VE90120
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE90120%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for VE90120: 2
2025-12-05 17:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: TE34497
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE34497%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for TE34497: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: DB01800
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB01800%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for DB01800: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: SV50363
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV50363%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for SV50363: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: KT63770
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT63770%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for KT63770: 2
2025-12-05 17:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdda88c6-d5cf-573c-89e1-238c77011463 with identifier: MT68726
2025-12-05 17:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdda88c6-d5cf-573c-89e1-238c77011463 with scrape type 2
2025-12-05 17:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdda88c6-d5cf-573c-89e1-238c77011463 with scrape type 2
2025-12-05 17:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fdda88c6-d5cf-573c-89e1-238c77011463, identifier: MT68726
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: MK99075
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK99075%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for MK99075: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: FA21770
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA21770%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for FA21770: 2
2025-12-05 17:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fdda88c6-d5cf-573c-89e1-238c77011463 with identifier: MT68726
2025-12-05 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fdda88c6-d5cf-573c-89e1-238c77011463 with identifier: MT68726
2025-12-05 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fdda88c6-d5cf-573c-89e1-238c77011463 spider: auto1.fr
2025-12-05 17:00:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fdda88c6-d5cf-573c-89e1-238c77011463 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:12:42Z',
'fuel_type': 'diesel',
'id': 'fdda88c6-d5cf-573c-89e1-238c77011463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT68726',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 100256,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT68726%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Saving data for MT68726: {'auction_closing_time': 1765037562.0, 'created_time': 1764695224.245282, 'last_price_update_time': 1764954025.668165}
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT68726') HTTP/1.1" 204 0
2025-12-05 17:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP55900> (referer: https://www.auto1.com/v1/car-details-view/RP55900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: DS69215
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS69215%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for DS69215: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: YR76759
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR76759%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for YR76759: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: RJ12081
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ12081%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for RJ12081: 1
2025-12-05 17:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: ET75213
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET75213%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for ET75213: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: VN04293
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN04293%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for VN04293: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: PG90356
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG90356%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for PG90356: 2
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: BE96307
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE96307%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for BE96307: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: JC58313
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC58313%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for JC58313: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: NK20323
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK20323%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for NK20323: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: SE91512
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE91512%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for SE91512: 2
2025-12-05 17:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG66884> (referer: https://www.auto1.com/v1/car-details-view/JG66884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: PM26392
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM26392%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for PM26392: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: MB79553
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB79553%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for MB79553: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: CG25594
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG25594%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for CG25594: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: VP01740
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP01740%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for VP01740: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: CR47252
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR47252%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for CR47252: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: BA99603
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA99603%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for BA99603: 0
2025-12-05 17:00:25 [auto1.fr] INFO: Found listing with ID: GW42477
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW42477%27 HTTP/1.1" 200 None
2025-12-05 17:00:25 [auto1.fr] INFO: Scrape type for GW42477: 1
2025-12-05 17:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f0bf1b0-449f-5c56-af57-90c74c444b1a with identifier: RP55900
2025-12-05 17:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0bf1b0-449f-5c56-af57-90c74c444b1a with scrape type 2
2025-12-05 17:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f0bf1b0-449f-5c56-af57-90c74c444b1a with scrape type 2
2025-12-05 17:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f0bf1b0-449f-5c56-af57-90c74c444b1a, identifier: RP55900
2025-12-05 17:00:26 [auto1.fr] INFO: Found listing with ID: EW04528
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW04528%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.fr] INFO: Scrape type for EW04528: 2
2025-12-05 17:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f0bf1b0-449f-5c56-af57-90c74c444b1a with identifier: RP55900
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2025-12-05 17:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f0bf1b0-449f-5c56-af57-90c74c444b1a with identifier: RP55900
2025-12-05 17:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f0bf1b0-449f-5c56-af57-90c74c444b1a with identifier: RP55900 to the API
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RP55900>
{'auction_title': '',
'c_o_2_emission_value': 24,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:12:22Z',
'fuel_type': 'hybrid',
'id': '9f0bf1b0-449f-5c56-af57-90c74c444b1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP55900',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Ford',
'model': 'Kuga',
'odometer': 71101,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2022}
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP55900%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.fr] INFO: Saving data for RP55900: {'auction_closing_time': 1765037542.0, 'created_time': 1764756235.207009, 'last_price_update_time': 1764954026.596992}
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP55900') HTTP/1.1" 204 0
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL38935> (referer: https://www.auto1.com/v1/car-details-view/EL38935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC62751> (referer: https://www.auto1.com/v1/car-details-view/DC62751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT93014> (referer: https://www.auto1.com/v1/car-details-view/MT93014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de09550-8469-5e5a-bf66-86b4cdb8f80d with identifier: JG66884
2025-12-05 17:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de09550-8469-5e5a-bf66-86b4cdb8f80d with scrape type 2
2025-12-05 17:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de09550-8469-5e5a-bf66-86b4cdb8f80d with scrape type 2
2025-12-05 17:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9de09550-8469-5e5a-bf66-86b4cdb8f80d, identifier: JG66884
2025-12-05 17:00:26 [auto1.fr] INFO: Found listing with ID: WG69168
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG69168%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.fr] INFO: Scrape type for WG69168: 0
2025-12-05 17:00:26 [auto1.fr] INFO: Found listing with ID: XW79170
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW79170%27 HTTP/1.1" 200 None
2025-12-05 17:00:26 [auto1.fr] INFO: Scrape type for XW79170: 2
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9de09550-8469-5e5a-bf66-86b4cdb8f80d with identifier: JG66884
2025-12-05 17:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9de09550-8469-5e5a-bf66-86b4cdb8f80d with identifier: JG66884
2025-12-05 17:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9de09550-8469-5e5a-bf66-86b4cdb8f80d with identifier: JG66884 to the API
2025-12-05 17:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG66884>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:10:54Z',
'fuel_type': 'petrol',
'id': '9de09550-8469-5e5a-bf66-86b4cdb8f80d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG66884',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Renault',
'model': 'Megane',
'odometer': 55095,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG66884%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [auto1.fr] INFO: Saving data for JG66884: {'auction_closing_time': 1765037454.0, 'created_time': 1762276321.862517, 'last_price_update_time': 1764954027.622366}
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG66884') HTTP/1.1" 204 0
2025-12-05 17:00:27 [auto1.fr] INFO: Found listing with ID: NM64607
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM64607%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [auto1.fr] INFO: Scrape type for NM64607: 0
2025-12-05 17:00:27 [auto1.fr] INFO: Found listing with ID: HW92301
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW92301%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [auto1.fr] INFO: Scrape type for HW92301: 2
2025-12-05 17:00:27 [auto1.fr] INFO: Found listing with ID: GC92578
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC92578%27 HTTP/1.1" 200 None
2025-12-05 17:00:27 [auto1.fr] INFO: Scrape type for GC92578: 2
2025-12-05 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1 with identifier: EL38935
2025-12-05 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1 with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1 with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1, identifier: EL38935
2025-12-05 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29cf92bb-9855-54c5-b8e1-462af53487f5 with identifier: DC62751
2025-12-05 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29cf92bb-9855-54c5-b8e1-462af53487f5 with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29cf92bb-9855-54c5-b8e1-462af53487f5 with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29cf92bb-9855-54c5-b8e1-462af53487f5, identifier: DC62751
2025-12-05 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5df05a2-ca44-5244-99d2-9180eca032ee with identifier: MT93014
2025-12-05 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5df05a2-ca44-5244-99d2-9180eca032ee with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5df05a2-ca44-5244-99d2-9180eca032ee with scrape type 2
2025-12-05 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5df05a2-ca44-5244-99d2-9180eca032ee, identifier: MT93014
2025-12-05 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1 with identifier: EL38935
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1 with identifier: EL38935
2025-12-05 17:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2917bc00-7b96-5da1-a2c6-a9fc1a67bde1 with identifier: EL38935 to the API
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL38935>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:48:50Z',
'fuel_type': 'petrol',
'id': '2917bc00-7b96-5da1-a2c6-a9fc1a67bde1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL38935',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 48185,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL38935%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.fr] INFO: Saving data for EL38935: {'auction_closing_time': 1765039730.0, 'created_time': 1764482960.31192, 'last_price_update_time': 1764954028.294353}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EL38935') HTTP/1.1" 204 0
2025-12-05 17:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29cf92bb-9855-54c5-b8e1-462af53487f5 with identifier: DC62751
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2025-12-05 17:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29cf92bb-9855-54c5-b8e1-462af53487f5 with identifier: DC62751
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150460 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
150460
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29cf92bb-9855-54c5-b8e1-462af53487f5 spider: auto1.fr
2025-12-05 17:00:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 29cf92bb-9855-54c5-b8e1-462af53487f5 due to rule: high_mileage_for_country.json, error: 150460 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
150460
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:34:09Z',
'fuel_type': 'diesel',
'id': '29cf92bb-9855-54c5-b8e1-462af53487f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC62751',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'BMW',
'model': 'X3',
'odometer': 150460,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC62751%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.fr] INFO: Saving data for DC62751: {'auction_closing_time': 1765038849.0, 'created_time': 1764349544.943815, 'last_price_update_time': 1764954028.715823}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC62751') HTTP/1.1" 204 0
2025-12-05 17:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5df05a2-ca44-5244-99d2-9180eca032ee with identifier: MT93014
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5df05a2-ca44-5244-99d2-9180eca032ee with identifier: MT93014
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech business r', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 60579, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mt93014', 'expiration_date': '2025-12-06t16:04:22z', 'origin_country_code': 'fr', 'trim': 'business r', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'a5df05a2-ca44-5244-99d2-9180eca032ee', 'current_year_diff': 5, 'age_in_months': 63, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 60579}
Failed validating None in schema:
False
On instance:
{'age_in_months': 63,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:04:22z',
'fuel_type': 'petrol',
'id': 'a5df05a2-ca44-5244-99d2-9180eca032ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mt93014',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 60579,
'odometer_in_km': 60579,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech business r',
'transmission': 'manual',
'trim': 'business r',
'year': 2020}
2025-12-05 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a5df05a2-ca44-5244-99d2-9180eca032ee spider: auto1.fr
2025-12-05 17:00:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a5df05a2-ca44-5244-99d2-9180eca032ee due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech business r', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 60579, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mt93014', 'expiration_date': '2025-12-06t16:04:22z', 'origin_country_code': 'fr', 'trim': 'business r', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'a5df05a2-ca44-5244-99d2-9180eca032ee', 'current_year_diff': 5, 'age_in_months': 63, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 60579}
Failed validating None in schema:
False
On instance:
{'age_in_months': 63,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:04:22z',
'fuel_type': 'petrol',
'id': 'a5df05a2-ca44-5244-99d2-9180eca032ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mt93014',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 60579,
'odometer_in_km': 60579,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech business r',
'transmission': 'manual',
'trim': 'business r',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:04:22Z',
'fuel_type': 'petrol',
'id': 'a5df05a2-ca44-5244-99d2-9180eca032ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT93014',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '208',
'odometer': 60579,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Business R',
'transmission': 'manual',
'trim': 'Business R',
'year': 2020}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT93014%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.fr] INFO: Saving data for MT93014: {'auction_closing_time': 1765037062.0, 'created_time': 1764608979.699238, 'last_price_update_time': 1764954028.92289}
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT93014') HTTP/1.1" 204 0
2025-12-05 17:00:28 [auto1.fr] INFO: Found listing with ID: LR44316
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR44316%27 HTTP/1.1" 200 None
2025-12-05 17:00:28 [auto1.fr] INFO: Scrape type for LR44316: 0
2025-12-05 17:00:28 [auto1.fr] INFO: Found listing with ID: GN88553
2025-12-05 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN88553%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for GN88553: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: SV86552
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV86552%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for SV86552: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: SH06459
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH06459%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for SH06459: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: CS32718
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS32718%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for CS32718: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: AH96961
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH96961%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for AH96961: 2
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE90120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: LM62028
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM62028%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for LM62028: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: SJ91632
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ91632%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for SJ91632: 2
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA21770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT63770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: ZK42482
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK42482%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for ZK42482: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: WP83557
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP83557%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for WP83557: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: RA19694
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA19694%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for RA19694: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: BU04449
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU04449%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for BU04449: 2
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: MV08230
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for MV08230: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: EE37125
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE37125%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for EE37125: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: WZ48332
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ48332%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for WZ48332: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: XP15808
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP15808%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for XP15808: 2
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: EJ83084
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ83084%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for EJ83084: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: YH55923
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH55923%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for YH55923: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: UU44063
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU44063%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for UU44063: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: MX55378
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX55378%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for MX55378: 2
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: NK83578
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK83578%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for NK83578: 2
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: LT03703
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT03703%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for LT03703: 2
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: MK77081
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK77081%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for MK77081: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: RU56730
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU56730%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for RU56730: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: UY60451
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY60451%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for UY60451: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: DF36540
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF36540%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for DF36540: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: AX13210
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX13210%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for AX13210: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: SW54914
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW54914%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for SW54914: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: AC04106
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC04106%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for AC04106: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: FL59835
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL59835%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for FL59835: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: NN20827
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN20827%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for NN20827: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: ZR97376
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR97376%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for ZR97376: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: LX21611
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX21611%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for LX21611: 2
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: ZX21358
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX21358%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for ZX21358: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: TP21809
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP21809%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for TP21809: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: ZY11558
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY11558%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for ZY11558: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: PV07284
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV07284%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for PV07284: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: EL84653
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL84653%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for EL84653: 2
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ12081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG90356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW42477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: BL95771
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL95771%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for BL95771: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: NZ83514
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ83514%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for NZ83514: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: UP32645
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP32645%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for UP32645: 2
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE91512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: ER30729
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER30729%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for ER30729: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: LB11458
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB11458%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for LB11458: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: RU04696
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU04696%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for RU04696: 2
2025-12-05 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: DF14697
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF14697%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for DF14697: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: WM72700
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM72700%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for WM72700: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: UT53837
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT53837%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for UT53837: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: LS16480
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS16480%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for LS16480: 0
2025-12-05 17:00:29 [auto1.fr] INFO: Found listing with ID: VS71332
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS71332%27 HTTP/1.1" 200 None
2025-12-05 17:00:29 [auto1.fr] INFO: Scrape type for VS71332: 0
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW79170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW92301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ91632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH96961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW04528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE90120> (referer: https://www.auto1.com/v1/car-details-view/VE90120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:30 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:30 [auto1.fr] INFO: Found listing with ID: FC78984
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC78984%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.fr] INFO: Scrape type for FC78984: 0
2025-12-05 17:00:30 [auto1.fr] INFO: Found listing with ID: FP51457
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP51457%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.fr] INFO: Scrape type for FP51457: 0
2025-12-05 17:00:30 [auto1.fr] INFO: Found listing with ID: LU70512
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU70512%27 HTTP/1.1" 200 None
2025-12-05 17:00:30 [auto1.fr] INFO: Scrape type for LU70512: 0
2025-12-05 17:00:30 [auto1.fr] INFO: Found listing with ID: TE52575
2025-12-05 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE52575%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for TE52575: 2
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: KP84570
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP84570%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for KP84570: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: KW96349
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW96349%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for KW96349: 2
2025-12-05 17:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be546a2-3e9b-5da6-8dcd-950e9357330c with identifier: VE90120
2025-12-05 17:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be546a2-3e9b-5da6-8dcd-950e9357330c with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2be546a2-3e9b-5da6-8dcd-950e9357330c with scrape type 2
2025-12-05 17:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2be546a2-3e9b-5da6-8dcd-950e9357330c, identifier: VE90120
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: GZ97606
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ97606%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for GZ97606: 1
2025-12-05 17:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2be546a2-3e9b-5da6-8dcd-950e9357330c with identifier: VE90120
2025-12-05 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2be546a2-3e9b-5da6-8dcd-950e9357330c with identifier: VE90120
2025-12-05 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152413 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152413
2025-12-05 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2be546a2-3e9b-5da6-8dcd-950e9357330c spider: auto1.fr
2025-12-05 17:00:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2be546a2-3e9b-5da6-8dcd-950e9357330c due to rule: high_mileage_for_country.json, error: 152413 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152413
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 160,
'expiration_date': '2025-12-06T16:18:40Z',
'fuel_type': 'diesel',
'id': '2be546a2-3e9b-5da6-8dcd-950e9357330c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE90120',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Renault',
'model': 'Espace',
'odometer': 152413,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2018}
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE90120%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Saving data for VE90120: {'auction_closing_time': 1765037920.0, 'created_time': 1762277220.393213, 'last_price_update_time': 1764954031.717091}
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE90120') HTTP/1.1" 204 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: JK02885
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK02885%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for JK02885: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: EP72323
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP72323%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for EP72323: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: AX88160
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX88160%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for AX88160: 2
2025-12-05 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT63770> (referer: https://www.auto1.com/v1/car-details-view/KT63770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC92578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA21770> (referer: https://www.auto1.com/v1/car-details-view/FA21770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU04449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL84653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: MA57469
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA57469%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for MA57469: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: HD96716
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD96716%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for HD96716: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: DH43732
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH43732%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for DH43732: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: MJ68632
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ68632%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for MJ68632: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: FF84577
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF84577%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for FF84577: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: YZ62600
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ62600%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for YZ62600: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: TY32710
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY32710%27 HTTP/1.1" 200 None
2025-12-05 17:00:31 [auto1.fr] INFO: Scrape type for TY32710: 0
2025-12-05 17:00:31 [auto1.fr] INFO: Found listing with ID: JM41616
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM41616%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for JM41616: 2
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: RW54524
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW54524%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for RW54524: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: EG41389
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG41389%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for EG41389: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: PR49600
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR49600%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for PR49600: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: JC36144
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC36144%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for JC36144: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: BL77494
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL77494%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for BL77494: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: FN27436
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN27436%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for FN27436: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: JK85208
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK85208%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for JK85208: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: WW22243
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW22243%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for WW22243: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: YS83777
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS83777%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for YS83777: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: SS48065
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS48065%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for SS48065: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: MM89113
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM89113%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for MM89113: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: CZ27676
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ27676%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for CZ27676: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: GF22806
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF22806%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for GF22806: 2
2025-12-05 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP15808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: FY54663
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY54663%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for FY54663: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: PX96803
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX96803%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for PX96803: 2
2025-12-05 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed291af-2bbd-5c30-95de-04e485a1b94a with identifier: KT63770
2025-12-05 17:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed291af-2bbd-5c30-95de-04e485a1b94a with scrape type 2
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed291af-2bbd-5c30-95de-04e485a1b94a with scrape type 2
2025-12-05 17:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5ed291af-2bbd-5c30-95de-04e485a1b94a, identifier: KT63770
2025-12-05 17:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25039e2b-ba03-531a-b121-6539923fc668 with identifier: FA21770
2025-12-05 17:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25039e2b-ba03-531a-b121-6539923fc668 with scrape type 2
2025-12-05 17:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25039e2b-ba03-531a-b121-6539923fc668 with scrape type 2
2025-12-05 17:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25039e2b-ba03-531a-b121-6539923fc668, identifier: FA21770
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: KV69084
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV69084%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for KV69084: 0
2025-12-05 17:00:32 [auto1.fr] INFO: Found listing with ID: FX84073
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX84073%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Scrape type for FX84073: 1
2025-12-05 17:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5ed291af-2bbd-5c30-95de-04e485a1b94a with identifier: KT63770
2025-12-05 17:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5ed291af-2bbd-5c30-95de-04e485a1b94a with identifier: KT63770
2025-12-05 17:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5ed291af-2bbd-5c30-95de-04e485a1b94a with identifier: KT63770 to the API
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KT63770>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:48:08Z',
'fuel_type': 'diesel',
'id': '5ed291af-2bbd-5c30-95de-04e485a1b94a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT63770',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'BMW',
'model': '5er',
'odometer': 123271,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2016}
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT63770%27 HTTP/1.1" 200 None
2025-12-05 17:00:32 [auto1.fr] INFO: Saving data for KT63770: {'auction_closing_time': 1765039688.0, 'created_time': 1762275732.690481, 'last_price_update_time': 1764954032.864507}
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KT63770') HTTP/1.1" 204 0
2025-12-05 17:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25039e2b-ba03-531a-b121-6539923fc668 with identifier: FA21770
2025-12-05 17:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25039e2b-ba03-531a-b121-6539923fc668 with identifier: FA21770
2025-12-05 17:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194730 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
194730
2025-12-05 17:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 25039e2b-ba03-531a-b121-6539923fc668 spider: auto1.fr
2025-12-05 17:00:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 25039e2b-ba03-531a-b121-6539923fc668 due to rule: high_mileage_for_country.json, error: 194730 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
194730
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:19:20Z',
'fuel_type': 'diesel',
'id': '25039e2b-ba03-531a-b121-6539923fc668',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA21770',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Peugeot',
'model': '308',
'odometer': 194730,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA21770%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.fr] INFO: Saving data for FA21770: {'auction_closing_time': 1765037960.0, 'created_time': 1764435748.107712, 'last_price_update_time': 1764954033.185696}
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA21770') HTTP/1.1" 204 0
2025-12-05 17:00:33 [auto1.fr] INFO: Found listing with ID: JC19185
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC19185%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.fr] INFO: Scrape type for JC19185: 0
2025-12-05 17:00:33 [auto1.fr] INFO: Found listing with ID: YD73523
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD73523%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.fr] INFO: Scrape type for YD73523: 0
2025-12-05 17:00:33 [auto1.fr] INFO: Found listing with ID: RR01899
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR01899%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.fr] INFO: Scrape type for RR01899: 1
2025-12-05 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT03703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX21611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:33 [auto1.fr] INFO: Found listing with ID: PC20610
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC20610%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.fr] INFO: Scrape type for PC20610: 0
2025-12-05 17:00:33 [auto1.fr] INFO: Found listing with ID: TT10041
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT10041%27 HTTP/1.1" 200 None
2025-12-05 17:00:33 [auto1.fr] INFO: Scrape type for TT10041: 0
2025-12-05 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP32645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW42477> (referer: https://www.auto1.com/v1/car-details-view/GW42477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE91512> (referer: https://www.auto1.com/v1/car-details-view/SE91512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d494ee3a-4a0a-524e-8e28-fdcf82f42fd8 with identifier: GW42477
2025-12-05 17:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d494ee3a-4a0a-524e-8e28-fdcf82f42fd8 with scrape type 1
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d494ee3a-4a0a-524e-8e28-fdcf82f42fd8
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_dae537dfc1f554046b39914086665322.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_d7668b9c7efef2159590af4e40043adb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_5cf1760334d706bfffbcb237db45c842.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_1d2ae2088102184d16260449f3aa1279.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_8d2fe651a7ebcc39a992f810e001a462.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_7edbb764056aef8d49ed10654b21eaf8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_d1d9d694a898563d16c43ad3433b8138.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_2aea7d54cbc14ab533216c45b1955be7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_672520ee0c82460642dff8d11c850da6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_6d76ba50f31879d8f551c04b679e7367.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg already downloaded
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F8d%252F018d5cef7482f395a852a28e5791f4dc%252Fpa%252FGW42477_0c2f44991445286ee68770e9463915ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg already downloaded
2025-12-05 17:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d494ee3a-4a0a-524e-8e28-fdcf82f42fd8, identifier: GW42477
2025-12-05 17:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d494ee3a-4a0a-524e-8e28-fdcf82f42fd8 with identifier: GW42477
2025-12-05 17:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d494ee3a-4a0a-524e-8e28-fdcf82f42fd8 with identifier: GW42477
2025-12-05 17:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'toyota auris touring sports 1.2 turbo executive', 'price': 0, 'currency': 'eur', 'make': 'toyota', 'model': 'auris touring sports', 'transmission': 'manual', 'odometer': 180430, 'odometer_reading_unit': 'km', 'registration_date': '2016-04-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gw42477', 'expiration_date': '2025-12-06t16:20:54z', 'origin_country_code': 'fr', 'trim': 'executive', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': 'd494ee3a-4a0a-524e-8e28-fdcf82f42fd8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51902}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55455}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47438}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62332}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57033}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63457}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66352}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90823}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57514}], 'current_year_diff': 9, 'age_in_months': 115, 'make_model': 'toyota auris touring sports', 'sanitized_make': 'toyota', 'odometer_in_km': 180430}
Failed validating None in schema:
False
On instance:
{'age_in_months': 115,
'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 115,
'expiration_date': '2025-12-06t16:20:54z',
'fuel_type': 'petrol',
'id': 'd494ee3a-4a0a-524e-8e28-fdcf82f42fd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gw42477',
'listing': 'auction',
'location': 'fr, allennes-les-marais',
'make': 'toyota',
'make_model': 'toyota auris touring sports',
'model': 'auris touring sports',
'odometer': 180430,
'odometer_in_km': 180430,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-26',
'sanitized_make': 'toyota',
'seats_number': 5,
'seller_name': None,
'title': 'toyota auris touring sports 1.2 turbo executive',
'transmission': 'manual',
'trim': 'executive',
'year': 2016}
2025-12-05 17:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: d494ee3a-4a0a-524e-8e28-fdcf82f42fd8 spider: auto1.fr
2025-12-05 17:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d494ee3a-4a0a-524e-8e28-fdcf82f42fd8 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'toyota auris touring sports 1.2 turbo executive', 'price': 0, 'currency': 'eur', 'make': 'toyota', 'model': 'auris touring sports', 'transmission': 'manual', 'odometer': 180430, 'odometer_reading_unit': 'km', 'registration_date': '2016-04-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gw42477', 'expiration_date': '2025-12-06t16:20:54z', 'origin_country_code': 'fr', 'trim': 'executive', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg', 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': 'd494ee3a-4a0a-524e-8e28-fdcf82f42fd8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51902}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55455}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47438}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62332}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57033}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63457}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66352}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90823}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57514}], 'current_year_diff': 9, 'age_in_months': 115, 'make_model': 'toyota auris touring sports', 'sanitized_make': 'toyota', 'odometer_in_km': 180430}
Failed validating None in schema:
False
On instance:
{'age_in_months': 115,
'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 115,
'expiration_date': '2025-12-06t16:20:54z',
'fuel_type': 'petrol',
'id': 'd494ee3a-4a0a-524e-8e28-fdcf82f42fd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gw42477',
'listing': 'auction',
'location': 'fr, allennes-les-marais',
'make': 'toyota',
'make_model': 'toyota auris touring sports',
'model': 'auris touring sports',
'odometer': 180430,
'odometer_in_km': 180430,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-26',
'sanitized_make': 'toyota',
'seats_number': 5,
'seller_name': None,
'title': 'toyota auris touring sports 1.2 turbo executive',
'transmission': 'manual',
'trim': 'executive',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:20:54Z',
'fuel_type': 'petrol',
'id': 'd494ee3a-4a0a-524e-8e28-fdcf82f42fd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW42477',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 180430,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg',
'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_dae537dfc1f554046b39914086665322.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d7668b9c7efef2159590af4e40043adb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_5cf1760334d706bfffbcb237db45c842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_1d2ae2088102184d16260449f3aa1279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8d2fe651a7ebcc39a992f810e001a462.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_7edbb764056aef8d49ed10654b21eaf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_d1d9d694a898563d16c43ad3433b8138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_8bf3d7e0ad1f1edaf13c2d8f7ca06f8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_2aea7d54cbc14ab533216c45b1955be7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_fcc2ac0466d80bd7b0e4018c39237d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_74e5af4cbb917c37acbff3ab12a8947d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d3cfafc409c629544bf5df1e786b7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_672520ee0c82460642dff8d11c850da6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_6d76ba50f31879d8f551c04b679e7367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_f2d0b9a09bde8cef87bc4365411b146a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d494ee3a-4a0a-524e-8e28-fdcf82f42fd8/d494ee3a-4a0a-524e-8e28-fdcf82f42fd8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/8d/018d5cef7482f395a852a28e5791f4dc/pa/GW42477_0c2f44991445286ee68770e9463915ab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.2 Turbo Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2016}
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW42477%27 HTTP/1.1" 200 None
2025-12-05 17:00:34 [auto1.fr] INFO: Saving data for GW42477: {'created_time': 1764954034.902319, 'last_price_update_time': 1764954034.902332, 'auction_closing_time': 1765038054.0}
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GW42477') HTTP/1.1" 204 0
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW79170> (referer: https://www.auto1.com/v1/car-details-view/XW79170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ97606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW04528> (referer: https://www.auto1.com/v1/car-details-view/EW04528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW92301> (referer: https://www.auto1.com/v1/car-details-view/HW92301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ91632> (referer: https://www.auto1.com/v1/car-details-view/SJ91632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH96961> (referer: https://www.auto1.com/v1/car-details-view/AH96961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f736c64d-1c90-5a1f-af98-4aa3b99f6a6c with identifier: SE91512
2025-12-05 17:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f736c64d-1c90-5a1f-af98-4aa3b99f6a6c with scrape type 2
2025-12-05 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f736c64d-1c90-5a1f-af98-4aa3b99f6a6c with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f736c64d-1c90-5a1f-af98-4aa3b99f6a6c, identifier: SE91512
2025-12-05 17:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f736c64d-1c90-5a1f-af98-4aa3b99f6a6c with identifier: SE91512
2025-12-05 17:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f736c64d-1c90-5a1f-af98-4aa3b99f6a6c with identifier: SE91512
2025-12-05 17:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f736c64d-1c90-5a1f-af98-4aa3b99f6a6c with identifier: SE91512 to the API
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE91512>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:48:38Z',
'fuel_type': 'hybrid',
'id': 'f736c64d-1c90-5a1f-af98-4aa3b99f6a6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE91512',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 30185,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid AWD-i Design',
'transmission': 'automatic',
'trim': 'AWD-i Design',
'year': 2021}
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE91512%27 HTTP/1.1" 200 None
2025-12-05 17:00:35 [auto1.fr] INFO: Saving data for SE91512: {'auction_closing_time': 1765039718.0, 'created_time': 1764090204.343016, 'last_price_update_time': 1764954035.316056}
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE91512') HTTP/1.1" 204 0
2025-12-05 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1d10cc0-c11c-52b9-8457-92201469eac7 with identifier: XW79170
2025-12-05 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1d10cc0-c11c-52b9-8457-92201469eac7 with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1d10cc0-c11c-52b9-8457-92201469eac7 with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e1d10cc0-c11c-52b9-8457-92201469eac7, identifier: XW79170
2025-12-05 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7f1622-16b4-533e-a227-9676df1386ce with identifier: EW04528
2025-12-05 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7f1622-16b4-533e-a227-9676df1386ce with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a7f1622-16b4-533e-a227-9676df1386ce with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a7f1622-16b4-533e-a227-9676df1386ce, identifier: EW04528
2025-12-05 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0201871-5619-53c9-b0c7-ae66efd7d13a with identifier: HW92301
2025-12-05 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0201871-5619-53c9-b0c7-ae66efd7d13a with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0201871-5619-53c9-b0c7-ae66efd7d13a with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0201871-5619-53c9-b0c7-ae66efd7d13a, identifier: HW92301
2025-12-05 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 362e3518-990c-5a1c-9fa4-d8e017920090 with identifier: SJ91632
2025-12-05 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362e3518-990c-5a1c-9fa4-d8e017920090 with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 362e3518-990c-5a1c-9fa4-d8e017920090 with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 362e3518-990c-5a1c-9fa4-d8e017920090, identifier: SJ91632
2025-12-05 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17fa31d5-f7da-559d-98e3-2238879f9eff with identifier: AH96961
2025-12-05 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17fa31d5-f7da-559d-98e3-2238879f9eff with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17fa31d5-f7da-559d-98e3-2238879f9eff with scrape type 2
2025-12-05 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17fa31d5-f7da-559d-98e3-2238879f9eff, identifier: AH96961
2025-12-05 17:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e1d10cc0-c11c-52b9-8457-92201469eac7 with identifier: XW79170
2025-12-05 17:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e1d10cc0-c11c-52b9-8457-92201469eac7 with identifier: XW79170
2025-12-05 17:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e1d10cc0-c11c-52b9-8457-92201469eac7 with identifier: XW79170 to the API
2025-12-05 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW79170>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:33:03Z',
'fuel_type': 'petrol',
'id': 'e1d10cc0-c11c-52b9-8457-92201469eac7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW79170',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Audi',
'model': 'Q2',
'odometer': 148354,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.4 TFSI ACT Design luxe',
'transmission': 'automatic',
'trim': 'Design luxe',
'year': 2017}
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW79170%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [auto1.fr] INFO: Saving data for XW79170: {'auction_closing_time': 1765038783.0, 'created_time': 1764756328.867784, 'last_price_update_time': 1764954036.112652}
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XW79170') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a7f1622-16b4-533e-a227-9676df1386ce with identifier: EW04528
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2025-12-05 17:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a7f1622-16b4-533e-a227-9676df1386ce with identifier: EW04528
2025-12-05 17:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7a7f1622-16b4-533e-a227-9676df1386ce with identifier: EW04528 to the API
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW04528>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 184,
'expiration_date': '2025-12-06T16:27:34Z',
'fuel_type': 'electro',
'id': '7a7f1622-16b4-533e-a227-9676df1386ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW04528',
'listing': 'auction',
'location': 'FR, Nanterre',
'make': 'MINI',
'model': 'MINI',
'odometer': 26676,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-30',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper SE Essential Trim',
'transmission': 'automatic',
'trim': 'Essential Trim',
'year': 2021}
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW04528%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [auto1.fr] INFO: Saving data for EW04528: {'auction_closing_time': 1765038454.0, 'created_time': 1764842640.330322, 'last_price_update_time': 1764954036.635717}
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW04528') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0201871-5619-53c9-b0c7-ae66efd7d13a with identifier: HW92301
2025-12-05 17:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0201871-5619-53c9-b0c7-ae66efd7d13a with identifier: HW92301
2025-12-05 17:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0201871-5619-53c9-b0c7-ae66efd7d13a with identifier: HW92301 to the API
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW92301>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:27:20Z',
'fuel_type': 'hybrid',
'id': 'd0201871-5619-53c9-b0c7-ae66efd7d13a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW92301',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 23735,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2023}
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW92301%27 HTTP/1.1" 200 None
2025-12-05 17:00:36 [auto1.fr] INFO: Saving data for HW92301: {'auction_closing_time': 1765038440.0, 'created_time': 1764842748.183666, 'last_price_update_time': 1764954036.937127}
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW92301') HTTP/1.1" 204 0
2025-12-05 17:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 362e3518-990c-5a1c-9fa4-d8e017920090 with identifier: SJ91632
2025-12-05 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2025-12-05 17:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 362e3518-990c-5a1c-9fa4-d8e017920090 with identifier: SJ91632
2025-12-05 17:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 362e3518-990c-5a1c-9fa4-d8e017920090 with identifier: SJ91632 to the API
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ91632>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:27:55Z',
'fuel_type': 'petrol',
'id': '362e3518-990c-5a1c-9fa4-d8e017920090',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ91632',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Seat',
'model': 'Arona',
'odometer': 67223,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2020}
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ91632%27 HTTP/1.1" 200 None
2025-12-05 17:00:37 [auto1.fr] INFO: Saving data for SJ91632: {'auction_closing_time': 1765038475.0, 'created_time': 1763399699.119582, 'last_price_update_time': 1764954037.421548}
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ91632') HTTP/1.1" 204 0
2025-12-05 17:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17fa31d5-f7da-559d-98e3-2238879f9eff with identifier: AH96961
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17fa31d5-f7da-559d-98e3-2238879f9eff with identifier: AH96961
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 44592, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah96961', 'expiration_date': '2025-12-06t16:14:39z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'ingré', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '17fa31d5-f7da-559d-98e3-2238879f9eff', 'current_year_diff': 6, 'age_in_months': 78, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 44592}
Failed validating None in schema:
False
On instance:
{'age_in_months': 78,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:14:39z',
'fuel_type': 'petrol',
'id': '17fa31d5-f7da-559d-98e3-2238879f9eff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah96961',
'listing': 'auction',
'location': 'ingré',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 44592,
'odometer_in_km': 44592,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-23',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2019}
2025-12-05 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 17fa31d5-f7da-559d-98e3-2238879f9eff spider: auto1.fr
2025-12-05 17:00:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 17fa31d5-f7da-559d-98e3-2238879f9eff due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 44592, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah96961', 'expiration_date': '2025-12-06t16:14:39z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'ingré', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '17fa31d5-f7da-559d-98e3-2238879f9eff', 'current_year_diff': 6, 'age_in_months': 78, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 44592}
Failed validating None in schema:
False
On instance:
{'age_in_months': 78,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:14:39z',
'fuel_type': 'petrol',
'id': '17fa31d5-f7da-559d-98e3-2238879f9eff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah96961',
'listing': 'auction',
'location': 'ingré',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 44592,
'odometer_in_km': 44592,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-23',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:14:39Z',
'fuel_type': 'petrol',
'id': '17fa31d5-f7da-559d-98e3-2238879f9eff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH96961',
'listing': 'auction',
'location': 'Ingré',
'make': 'Peugeot',
'model': '2008',
'odometer': 44592,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH96961%27 HTTP/1.1" 200 None
2025-12-05 17:00:37 [auto1.fr] INFO: Saving data for AH96961: {'auction_closing_time': 1765037679.0, 'created_time': 1764842734.323479, 'last_price_update_time': 1764954037.662609}
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AH96961') HTTP/1.1" 204 0
2025-12-05 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW96349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE52575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR01899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX84073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF22806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: NL32967
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL32967%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for NL32967: 2
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: VW23391
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW23391%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for VW23391: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: AD10431
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD10431%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for AD10431: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: EP46835
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP46835%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for EP46835: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: GF43972
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF43972%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for GF43972: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: SB59403
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB59403%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for SB59403: 2
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: SM92526
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM92526%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for SM92526: 2
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: HK15612
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK15612%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for HK15612: 1
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX21611> (referer: https://www.auto1.com/v1/car-details-view/LX21611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: FG68940
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG68940%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for FG68940: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: JB33063
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB33063%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for JB33063: 2
2025-12-05 17:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: TL76120
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL76120%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for TL76120: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: SM22522
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM22522%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for SM22522: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: GU29809
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU29809%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for GU29809: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: KC41750
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC41750%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for KC41750: 2
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: WB34867
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB34867%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for WB34867: 2
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: VN69144
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN69144%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for VN69144: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: PS84396
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS84396%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for PS84396: 2
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: TE70213
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE70213%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for TE70213: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: TL86613
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL86613%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for TL86613: 2
2025-12-05 17:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG90356> (referer: https://www.auto1.com/v1/car-details-view/PG90356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 255199fd-b382-5c4d-becd-90ce57ddb0dc with identifier: LX21611
2025-12-05 17:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255199fd-b382-5c4d-becd-90ce57ddb0dc with scrape type 2
2025-12-05 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 255199fd-b382-5c4d-becd-90ce57ddb0dc with scrape type 2
2025-12-05 17:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 255199fd-b382-5c4d-becd-90ce57ddb0dc, identifier: LX21611
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: BR54779
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR54779%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for BR54779: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: UE75229
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE75229%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for UE75229: 0
2025-12-05 17:00:38 [auto1.fr] INFO: Found listing with ID: UB27704
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB27704%27 HTTP/1.1" 200 None
2025-12-05 17:00:38 [auto1.fr] INFO: Scrape type for UB27704: 1
2025-12-05 17:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 255199fd-b382-5c4d-becd-90ce57ddb0dc with identifier: LX21611
2025-12-05 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 255199fd-b382-5c4d-becd-90ce57ddb0dc with identifier: LX21611
2025-12-05 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 83908, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx21611', 'expiration_date': '2025-12-06t16:32:01z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '255199fd-b382-5c4d-becd-90ce57ddb0dc', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 83908}
Failed validating None in schema:
False
On instance:
{'age_in_months': 95,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:32:01z',
'fuel_type': 'petrol',
'id': '255199fd-b382-5c4d-becd-90ce57ddb0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx21611',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 83908,
'odometer_in_km': 83908,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-19',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti active',
'transmission': 'manual',
'trim': 'active',
'year': 2017}
2025-12-05 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 255199fd-b382-5c4d-becd-90ce57ddb0dc spider: auto1.fr
2025-12-05 17:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 255199fd-b382-5c4d-becd-90ce57ddb0dc due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 83908, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx21611', 'expiration_date': '2025-12-06t16:32:01z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '255199fd-b382-5c4d-becd-90ce57ddb0dc', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 83908}
Failed validating None in schema:
False
On instance:
{'age_in_months': 95,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:32:01z',
'fuel_type': 'petrol',
'id': '255199fd-b382-5c4d-becd-90ce57ddb0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx21611',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 83908,
'odometer_in_km': 83908,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-19',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti active',
'transmission': 'manual',
'trim': 'active',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:32:01Z',
'fuel_type': 'petrol',
'id': '255199fd-b382-5c4d-becd-90ce57ddb0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX21611',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '208',
'odometer': 83908,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX21611%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Saving data for LX21611: {'auction_closing_time': 1765038721.0, 'created_time': 1764748836.030444, 'last_price_update_time': 1764954039.04794}
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LX21611') HTTP/1.1" 204 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: DX70763
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX70763%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for DX70763: 2
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP32645> (referer: https://www.auto1.com/v1/car-details-view/UP32645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT03703> (referer: https://www.auto1.com/v1/car-details-view/LT03703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP15808> (referer: https://www.auto1.com/v1/car-details-view/XP15808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba7cb96-c821-51b6-8492-4d778eb42724 with identifier: PG90356
2025-12-05 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba7cb96-c821-51b6-8492-4d778eb42724 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ba7cb96-c821-51b6-8492-4d778eb42724 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9ba7cb96-c821-51b6-8492-4d778eb42724, identifier: PG90356
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: GU53043
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU53043%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for GU53043: 2
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ba7cb96-c821-51b6-8492-4d778eb42724 with identifier: PG90356
2025-12-05 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ba7cb96-c821-51b6-8492-4d778eb42724 with identifier: PG90356
2025-12-05 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 135646, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pg90356', 'expiration_date': '2025-12-06t16:10:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '9ba7cb96-c821-51b6-8492-4d778eb42724', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 135646}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:10:08z',
'fuel_type': 'petrol',
'id': '9ba7cb96-c821-51b6-8492-4d778eb42724',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pg90356',
'listing': 'auction',
'location': 'fr, allennes-les-marais',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 135646,
'odometer_in_km': 135646,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
2025-12-05 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 9ba7cb96-c821-51b6-8492-4d778eb42724 spider: auto1.fr
2025-12-05 17:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9ba7cb96-c821-51b6-8492-4d778eb42724 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 135646, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pg90356', 'expiration_date': '2025-12-06t16:10:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '9ba7cb96-c821-51b6-8492-4d778eb42724', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 135646}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:10:08z',
'fuel_type': 'petrol',
'id': '9ba7cb96-c821-51b6-8492-4d778eb42724',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pg90356',
'listing': 'auction',
'location': 'fr, allennes-les-marais',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 135646,
'odometer_in_km': 135646,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:10:08Z',
'fuel_type': 'petrol',
'id': '9ba7cb96-c821-51b6-8492-4d778eb42724',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG90356',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '308',
'odometer': 135646,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG90356%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Saving data for PG90356: {'auction_closing_time': 1765037408.0, 'created_time': 1764136862.988639, 'last_price_update_time': 1764954039.518559}
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PG90356') HTTP/1.1" 204 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: TW74803
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW74803%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for TW74803: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: SS06014
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS06014%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for SS06014: 1
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL84653> (referer: https://www.auto1.com/v1/car-details-view/EL84653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU04449> (referer: https://www.auto1.com/v1/car-details-view/BU04449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: WH02356
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH02356%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for WH02356: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: EL26773
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL26773%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for EL26773: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: FC55159
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC55159%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for FC55159: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: GU82019
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU82019%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for GU82019: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: NA03464
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA03464%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for NA03464: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: SZ92729
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ92729%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for SZ92729: 0
2025-12-05 17:00:39 [auto1.fr] INFO: Found listing with ID: FF24140
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF24140%27 HTTP/1.1" 200 None
2025-12-05 17:00:39 [auto1.fr] INFO: Scrape type for FF24140: 1
2025-12-05 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 075435d6-0ce0-5802-ba27-d3713bc28326 with identifier: UP32645
2025-12-05 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 075435d6-0ce0-5802-ba27-d3713bc28326 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 075435d6-0ce0-5802-ba27-d3713bc28326 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 075435d6-0ce0-5802-ba27-d3713bc28326, identifier: UP32645
2025-12-05 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79df30de-dcd8-56b7-96b7-2a27d35eb671 with identifier: LT03703
2025-12-05 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79df30de-dcd8-56b7-96b7-2a27d35eb671 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79df30de-dcd8-56b7-96b7-2a27d35eb671 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79df30de-dcd8-56b7-96b7-2a27d35eb671, identifier: LT03703
2025-12-05 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad73914-88b4-55ef-83bb-81078f7ecd94 with identifier: XP15808
2025-12-05 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad73914-88b4-55ef-83bb-81078f7ecd94 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ad73914-88b4-55ef-83bb-81078f7ecd94 with scrape type 2
2025-12-05 17:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ad73914-88b4-55ef-83bb-81078f7ecd94, identifier: XP15808
2025-12-05 17:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 075435d6-0ce0-5802-ba27-d3713bc28326 with identifier: UP32645
2025-12-05 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 075435d6-0ce0-5802-ba27-d3713bc28326 with identifier: UP32645
2025-12-05 17:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 075435d6-0ce0-5802-ba27-d3713bc28326 with identifier: UP32645 to the API
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP32645>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:27:30Z',
'fuel_type': 'diesel',
'id': '075435d6-0ce0-5802-ba27-d3713bc28326',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP32645',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 144773,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-05',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2017}
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP32645%27 HTTP/1.1" 200 None
2025-12-05 17:00:40 [auto1.fr] INFO: Saving data for UP32645: {'auction_closing_time': 1765038450.0, 'created_time': 1764756443.239378, 'last_price_update_time': 1764954040.279307}
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UP32645') HTTP/1.1" 204 0
2025-12-05 17:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79df30de-dcd8-56b7-96b7-2a27d35eb671 with identifier: LT03703
2025-12-05 17:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79df30de-dcd8-56b7-96b7-2a27d35eb671 with identifier: LT03703
2025-12-05 17:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79df30de-dcd8-56b7-96b7-2a27d35eb671 with identifier: LT03703 to the API
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT03703>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2025-12-06T16:13:40Z',
'fuel_type': 'diesel',
'id': '79df30de-dcd8-56b7-96b7-2a27d35eb671',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT03703',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '208',
'odometer': 113392,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-30',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot 208 1.5 Blue-HDi Active Business R',
'transmission': 'manual',
'trim': 'Active Business R',
'year': 2021}
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT03703%27 HTTP/1.1" 200 None
2025-12-05 17:00:40 [auto1.fr] INFO: Saving data for LT03703: {'auction_closing_time': 1765037620.0, 'created_time': 1764748840.639056, 'last_price_update_time': 1764954040.728774}
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LT03703') HTTP/1.1" 204 0
2025-12-05 17:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ad73914-88b4-55ef-83bb-81078f7ecd94 with identifier: XP15808
2025-12-05 17:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ad73914-88b4-55ef-83bb-81078f7ecd94 with identifier: XP15808
2025-12-05 17:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170265 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170265
2025-12-05 17:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8ad73914-88b4-55ef-83bb-81078f7ecd94 spider: auto1.fr
2025-12-05 17:00:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8ad73914-88b4-55ef-83bb-81078f7ecd94 due to rule: high_mileage_for_country.json, error: 170265 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170265
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:50:00Z',
'fuel_type': 'diesel',
'id': '8ad73914-88b4-55ef-83bb-81078f7ecd94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP15808',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 170265,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Business Plus',
'transmission': 'automatic',
'trim': 'Business Plus',
'year': 2019}
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP15808%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Saving data for XP15808: {'auction_closing_time': 1765039800.0, 'created_time': 1764842666.587196, 'last_price_update_time': 1764954041.076953}
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP15808') HTTP/1.1" 204 0
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: VA65414
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA65414%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for VA65414: 0
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: AC11008
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC11008%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for AC11008: 0
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: FU00920
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU00920%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for FU00920: 2
2025-12-05 17:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX96803/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM41616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: FY50527
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY50527%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for FY50527: 0
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: BT73925
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT73925%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for BT73925: 0
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: SM72402
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM72402%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for SM72402: 0
2025-12-05 17:00:41 [auto1.fr] INFO: Found listing with ID: AT04620
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT04620%27 HTTP/1.1" 200 None
2025-12-05 17:00:41 [auto1.fr] INFO: Scrape type for AT04620: 0
2025-12-05 17:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de1edd4-0802-5e7f-8326-60bf3d8d71f7 with identifier: EL84653
2025-12-05 17:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de1edd4-0802-5e7f-8326-60bf3d8d71f7 with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de1edd4-0802-5e7f-8326-60bf3d8d71f7 with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2de1edd4-0802-5e7f-8326-60bf3d8d71f7, identifier: EL84653
2025-12-05 17:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449
2025-12-05 17:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7a1598a-e092-5261-9ded-2ac7b20c2cef with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7a1598a-e092-5261-9ded-2ac7b20c2cef with scrape type 2
2025-12-05 17:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7a1598a-e092-5261-9ded-2ac7b20c2cef, identifier: BU04449
2025-12-05 17:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2de1edd4-0802-5e7f-8326-60bf3d8d71f7 with identifier: EL84653
2025-12-05 17:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2de1edd4-0802-5e7f-8326-60bf3d8d71f7 with identifier: EL84653
2025-12-05 17:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2de1edd4-0802-5e7f-8326-60bf3d8d71f7 with identifier: EL84653 to the API
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL84653>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2025-12-06T16:39:17Z',
'fuel_type': 'diesel',
'id': '2de1edd4-0802-5e7f-8326-60bf3d8d71f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL84653',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 86074,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque D180 Mild-Hybrid R-dynamic SE',
'transmission': 'automatic',
'trim': 'R-dynamic SE',
'year': 2019}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL84653%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.fr] INFO: Saving data for EL84653: {'auction_closing_time': 1765039157.0, 'created_time': 1764748841.930226, 'last_price_update_time': 1764954042.039512}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EL84653') HTTP/1.1" 204 0
2025-12-05 17:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449
2025-12-05 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449
2025-12-05 17:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449 to the API
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU04449>
{'auction_title': '',
'c_o_2_emission_value': 93,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2025-12-06T16:23:46Z',
'fuel_type': 'petrol',
'id': 'f7a1598a-e092-5261-9ded-2ac7b20c2cef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU04449',
'listing': 'auction',
'location': 'Aubière',
'make': 'Peugeot',
'model': '108',
'odometer': 63797,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-27',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 108 1.0 VTi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2018}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU04449%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.fr] INFO: Saving data for BU04449: {'auction_closing_time': 1765038226.0, 'created_time': 1764842704.803699, 'last_price_update_time': 1764954042.338037}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU04449') HTTP/1.1" 204 0
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ97606> (referer: https://www.auto1.com/v1/car-details-view/GZ97606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX88160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE52575> (referer: https://www.auto1.com/v1/car-details-view/TE52575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90968ce-486a-570a-91e1-cee4dc6336a2 with identifier: GZ97606
2025-12-05 17:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90968ce-486a-570a-91e1-cee4dc6336a2 with scrape type 1
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_1dccf620ecc469149a46530393f00be2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_1dccf620ecc469149a46530393f00be2.jpg not downloaded yet
2025-12-05 17:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a6a139-2a19-5fc9-aa19-b205f8be8157 with identifier: TE52575
2025-12-05 17:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a6a139-2a19-5fc9-aa19-b205f8be8157 with scrape type 2
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a6a139-2a19-5fc9-aa19-b205f8be8157 with scrape type 2
2025-12-05 17:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 96a6a139-2a19-5fc9-aa19-b205f8be8157, identifier: TE52575
2025-12-05 17:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 96a6a139-2a19-5fc9-aa19-b205f8be8157 with identifier: TE52575
2025-12-05 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 96a6a139-2a19-5fc9-aa19-b205f8be8157 with identifier: TE52575
2025-12-05 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 43156, 'odometer_reading_unit': 'km', 'registration_date': '2016-07-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/te52575', 'expiration_date': '2025-12-06t16:13:47z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, montpellier', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '96a6a139-2a19-5fc9-aa19-b205f8be8157', 'current_year_diff': 9, 'age_in_months': 112, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 43156}
Failed validating None in schema:
False
On instance:
{'age_in_months': 112,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 3,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 70,
'expiration_date': '2025-12-06t16:13:47z',
'fuel_type': 'petrol',
'id': '96a6a139-2a19-5fc9-aa19-b205f8be8157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/te52575',
'listing': 'auction',
'location': 'fr, montpellier',
'make': 'fiat',
'make_model': 'fiat 500',
'model': '500',
'odometer': 43156,
'odometer_in_km': 43156,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-25',
'sanitized_make': 'fiat',
'seats_number': 5,
'seller_name': None,
'title': 'fiat 500 1.2 lounge',
'transmission': 'manual',
'trim': 'lounge',
'year': 2016}
2025-12-05 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 96a6a139-2a19-5fc9-aa19-b205f8be8157 spider: auto1.fr
2025-12-05 17:00:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 96a6a139-2a19-5fc9-aa19-b205f8be8157 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 43156, 'odometer_reading_unit': 'km', 'registration_date': '2016-07-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/te52575', 'expiration_date': '2025-12-06t16:13:47z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, montpellier', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '96a6a139-2a19-5fc9-aa19-b205f8be8157', 'current_year_diff': 9, 'age_in_months': 112, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 43156}
Failed validating None in schema:
False
On instance:
{'age_in_months': 112,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 3,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 70,
'expiration_date': '2025-12-06t16:13:47z',
'fuel_type': 'petrol',
'id': '96a6a139-2a19-5fc9-aa19-b205f8be8157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/te52575',
'listing': 'auction',
'location': 'fr, montpellier',
'make': 'fiat',
'make_model': 'fiat 500',
'model': '500',
'odometer': 43156,
'odometer_in_km': 43156,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-25',
'sanitized_make': 'fiat',
'seats_number': 5,
'seller_name': None,
'title': 'fiat 500 1.2 lounge',
'transmission': 'manual',
'trim': 'lounge',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:13:47Z',
'fuel_type': 'petrol',
'id': '96a6a139-2a19-5fc9-aa19-b205f8be8157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE52575',
'listing': 'auction',
'location': 'FR, Montpellier',
'make': 'Fiat',
'model': '500',
'odometer': 43156,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE52575%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [auto1.fr] INFO: Saving data for TE52575: {'auction_closing_time': 1765037627.0, 'created_time': 1764695565.89749, 'last_price_update_time': 1764954042.782671}
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE52575') HTTP/1.1" 204 0
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_547460aca5105e4a99273a69e71feb1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_547460aca5105e4a99273a69e71feb1e.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_66b3dac81650a10c80e2e5bbc9d1ed07.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_66b3dac81650a10c80e2e5bbc9d1ed07.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_c2e936000859b4e77322fbaf724f026f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_c2e936000859b4e77322fbaf724f026f.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_89c224a84fae56d7d35e086d442275c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_89c224a84fae56d7d35e086d442275c5.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_3d53dc8bfdbb2a60ef29963f318b584c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_3d53dc8bfdbb2a60ef29963f318b584c.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_ba6975cb9f56290be9df70196946e4ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_ba6975cb9f56290be9df70196946e4ac.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_5a857d5251c55ad2dcebb27aa1521fa2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5a857d5251c55ad2dcebb27aa1521fa2.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_d3a55062785462812e384c23993b791c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_d3a55062785462812e384c23993b791c.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_b53ce1aad32ea74b0d65ff06d39f4928.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_b53ce1aad32ea74b0d65ff06d39f4928.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_f99f92406d9fca1fb65e95af7be543cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f99f92406d9fca1fb65e95af7be543cb.jpg not downloaded yet
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_808d950c89d63a30f3dd4bb9baab18e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_808d950c89d63a30f3dd4bb9baab18e5.jpg not downloaded yet
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_21b90284d4859bf69e001ae3011b03d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_21b90284d4859bf69e001ae3011b03d2.jpg not downloaded yet
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_5b0f529b04d3fee06216c5988f1ce640.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5b0f529b04d3fee06216c5988f1ce640.jpg not downloaded yet
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_f41a6d9328c61c01f5a50e4c2ca51765.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f41a6d9328c61c01f5a50e4c2ca51765.jpg not downloaded yet
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_8eeedc183c317a3f82a937b08e618097.png%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_8eeedc183c317a3f82a937b08e618097.png not downloaded yet
2025-12-05 17:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW96349> (referer: https://www.auto1.com/v1/car-details-view/KW96349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ12081> (referer: https://www.auto1.com/v1/car-details-view/RJ12081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c68a0d96-f38b-598e-9817-d947147c6665 with identifier: KW96349
2025-12-05 17:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c68a0d96-f38b-598e-9817-d947147c6665 with scrape type 2
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c68a0d96-f38b-598e-9817-d947147c6665 with scrape type 2
2025-12-05 17:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c68a0d96-f38b-598e-9817-d947147c6665, identifier: KW96349
2025-12-05 17:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c68a0d96-f38b-598e-9817-d947147c6665 with identifier: KW96349
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c68a0d96-f38b-598e-9817-d947147c6665 with identifier: KW96349
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2025-12-05 17:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c68a0d96-f38b-598e-9817-d947147c6665 spider: auto1.fr
2025-12-05 17:00:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c68a0d96-f38b-598e-9817-d947147c6665 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:48:20Z',
'fuel_type': 'petrol',
'id': 'c68a0d96-f38b-598e-9817-d947147c6665',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW96349',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 87466,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TSI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW96349%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [auto1.fr] INFO: Saving data for KW96349: {'auction_closing_time': 1765039700.0, 'created_time': 1763366508.198291, 'last_price_update_time': 1764954043.581592}
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KW96349') HTTP/1.1" 204 0
2025-12-05 17:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC92578> (referer: https://www.auto1.com/v1/car-details-view/GC92578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK15612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16 with identifier: RJ12081
2025-12-05 17:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16 with scrape type 1
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_a13560da72ad8bf988c59f8c4aabfe6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_a13560da72ad8bf988c59f8c4aabfe6d.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_aa4767bccc8b5f8803aca011c034d42d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_aa4767bccc8b5f8803aca011c034d42d.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_19a108204d786e6ac74c3a23a6798775.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_19a108204d786e6ac74c3a23a6798775.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_6d5a64fc3b6ea600978118979dd1eb2b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_6d5a64fc3b6ea600978118979dd1eb2b.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_c55c1e5233dbcf8affd8ed3665a6e23e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_c55c1e5233dbcf8affd8ed3665a6e23e.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_4437e71e297cf3665a36ca160aa5282f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_4437e71e297cf3665a36ca160aa5282f.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_23b6fd0b362e6e464f8e657be146a142.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_23b6fd0b362e6e464f8e657be146a142.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_09fea589ee6f5a34d1d59c84a83d8110.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_09fea589ee6f5a34d1d59c84a83d8110.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_f32a54e8a286b16daf97d598c6daa55f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_f32a54e8a286b16daf97d598c6daa55f.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_a7c920a09d0d15a1da3b9e47e1343b23.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_a7c920a09d0d15a1da3b9e47e1343b23.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_e98118be95d16fef20f2bd8325ea7e2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_e98118be95d16fef20f2bd8325ea7e2f.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_55af293f0be459acc1f72061c1716ca6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_55af293f0be459acc1f72061c1716ca6.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_068638f2d9be20d5ac7ce3e49204c5f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_068638f2d9be20d5ac7ce3e49204c5f8.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_6a935944a728541c99b488945a7b753b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_6a935944a728541c99b488945a7b753b.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_b2596704a5e2b40de1b302418f812fc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_b2596704a5e2b40de1b302418f812fc9.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_09a21863b29580ea69cc2de95c4dd15e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_09a21863b29580ea69cc2de95c4dd15e.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_aaadecbc3488260a15fb704a7f77efa2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_aaadecbc3488260a15fb704a7f77efa2.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_1078d17f8e4cee8f546396d6b20fdcfc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_1078d17f8e4cee8f546396d6b20fdcfc.jpg already downloaded
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fca%252Ff8cab82ac72e49b55bf174fecacf7115%252Fpa%252FRJ12081_cc9437454ed37c03ba8377e07a7179e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_cc9437454ed37c03ba8377e07a7179e0.jpg already downloaded
2025-12-05 17:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16, identifier: RJ12081
2025-12-05 17:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16 with identifier: RJ12081
2025-12-05 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16 with identifier: RJ12081
2025-12-05 17:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70dbc42c-bb30-52d8-8a2b-bcc36c8cba16 with identifier: RJ12081 to the API
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RJ12081>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:09:39Z',
'fuel_type': 'petrol',
'id': '70dbc42c-bb30-52d8-8a2b-bcc36c8cba16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ12081',
'listing': 'auction',
'location': 'FR',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 54586,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photo_urls': ['https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_a13560da72ad8bf988c59f8c4aabfe6d.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_aa4767bccc8b5f8803aca011c034d42d.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_19a108204d786e6ac74c3a23a6798775.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_6d5a64fc3b6ea600978118979dd1eb2b.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_c55c1e5233dbcf8affd8ed3665a6e23e.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_4437e71e297cf3665a36ca160aa5282f.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_23b6fd0b362e6e464f8e657be146a142.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_09fea589ee6f5a34d1d59c84a83d8110.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_f32a54e8a286b16daf97d598c6daa55f.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_a7c920a09d0d15a1da3b9e47e1343b23.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_e98118be95d16fef20f2bd8325ea7e2f.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_55af293f0be459acc1f72061c1716ca6.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_068638f2d9be20d5ac7ce3e49204c5f8.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_6a935944a728541c99b488945a7b753b.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_b2596704a5e2b40de1b302418f812fc9.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_09a21863b29580ea69cc2de95c4dd15e.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_aaadecbc3488260a15fb704a7f77efa2.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_1078d17f8e4cee8f546396d6b20fdcfc.jpg',
'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_cc9437454ed37c03ba8377e07a7179e0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_a13560da72ad8bf988c59f8c4aabfe6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_aa4767bccc8b5f8803aca011c034d42d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_19a108204d786e6ac74c3a23a6798775.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_6d5a64fc3b6ea600978118979dd1eb2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_c55c1e5233dbcf8affd8ed3665a6e23e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_4437e71e297cf3665a36ca160aa5282f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_23b6fd0b362e6e464f8e657be146a142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_09fea589ee6f5a34d1d59c84a83d8110.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_f32a54e8a286b16daf97d598c6daa55f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_a7c920a09d0d15a1da3b9e47e1343b23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_e98118be95d16fef20f2bd8325ea7e2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_55af293f0be459acc1f72061c1716ca6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_068638f2d9be20d5ac7ce3e49204c5f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_6a935944a728541c99b488945a7b753b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_b2596704a5e2b40de1b302418f812fc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23761,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_09a21863b29580ea69cc2de95c4dd15e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22282,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_aaadecbc3488260a15fb704a7f77efa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26246,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_1078d17f8e4cee8f546396d6b20fdcfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70dbc42c-bb30-52d8-8a2b-bcc36c8cba16/70dbc42c-bb30-52d8-8a2b-bcc36c8cba16_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21779,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/ca/f8cab82ac72e49b55bf174fecacf7115/pa/RJ12081_cc9437454ed37c03ba8377e07a7179e0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2019}
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ12081%27 HTTP/1.1" 200 None
2025-12-05 17:00:44 [auto1.fr] INFO: Saving data for RJ12081: {'created_time': 1764954044.354166, 'last_price_update_time': 1764954044.354176, 'auction_closing_time': 1765037379.0}
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RJ12081') HTTP/1.1" 204 0
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f41a6d9328c61c01f5a50e4c2ca51765.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX70763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB27704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL86613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23bbdaf3-f811-5065-8337-ec5015c9a6bd with identifier: GC92578
2025-12-05 17:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23bbdaf3-f811-5065-8337-ec5015c9a6bd with scrape type 2
2025-12-05 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23bbdaf3-f811-5065-8337-ec5015c9a6bd with scrape type 2
2025-12-05 17:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23bbdaf3-f811-5065-8337-ec5015c9a6bd, identifier: GC92578
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23bbdaf3-f811-5065-8337-ec5015c9a6bd with identifier: GC92578
2025-12-05 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23bbdaf3-f811-5065-8337-ec5015c9a6bd with identifier: GC92578
2025-12-05 17:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23bbdaf3-f811-5065-8337-ec5015c9a6bd with identifier: GC92578 to the API
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC92578>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:27:29Z',
'fuel_type': 'diesel',
'id': '23bbdaf3-f811-5065-8337-ec5015c9a6bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC92578',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '5008',
'odometer': 121874,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-13',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi Allure Business',
'transmission': 'manual',
'trim': 'Allure Business',
'year': 2020}
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC92578%27 HTTP/1.1" 200 None
2025-12-05 17:00:44 [auto1.fr] INFO: Saving data for GC92578: {'auction_closing_time': 1765038449.0, 'created_time': 1764756469.035522, 'last_price_update_time': 1764954044.799361}
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC92578') HTTP/1.1" 204 0
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_8eeedc183c317a3f82a937b08e618097.png> (referer: https://www.auto1.com/)
2025-12-05 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR01899> (referer: https://www.auto1.com/v1/car-details-view/RR01899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57c1dd0>
2025-12-05 17:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_f41a6d9328c61c01f5a50e4c2ca51765.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f41a6d9328c61c01f5a50e4c2ca51765.jpg saved to cache
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS84396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS06014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:45 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:00:45 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:00:45 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a64cd0>
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_15.png HTTP/1.1" 201 0
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_8eeedc183c317a3f82a937b08e618097.png') HTTP/1.1" 204 0
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_8eeedc183c317a3f82a937b08e618097.png saved to cache
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7c8643d-4598-54a8-931a-03eb959fa2a9 with identifier: RR01899
2025-12-05 17:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c8643d-4598-54a8-931a-03eb959fa2a9 with scrape type 1
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item c7c8643d-4598-54a8-931a-03eb959fa2a9
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_c7d3f9b50824271776043afaf87ddc33.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_c7d3f9b50824271776043afaf87ddc33.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_65238a02357c17b7bea65dd2bf34c76b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_65238a02357c17b7bea65dd2bf34c76b.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_68295a939bebd6c8849a17294092dbe6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_68295a939bebd6c8849a17294092dbe6.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_0a963cb431e5ff638487023ec916a3d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_0a963cb431e5ff638487023ec916a3d9.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_688b63e9c0e62692b7b70fcfc37db8d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_688b63e9c0e62692b7b70fcfc37db8d5.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_ecacc0c2e4ce455ef35d45c846d2c3cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ecacc0c2e4ce455ef35d45c846d2c3cf.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_90233b1d67989becf53b4149016d05d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_90233b1d67989becf53b4149016d05d2.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_ff5848c2ffb4e84b0d8cfb1335c1fd49.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ff5848c2ffb4e84b0d8cfb1335c1fd49.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_d0ad28a7a212a9895c1146797b980fe9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_d0ad28a7a212a9895c1146797b980fe9.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_e7fb057635164ad35a7eb128ab5dca81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_e7fb057635164ad35a7eb128ab5dca81.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_bd1a24ee5d573f715b403dfad0e5a582.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_bd1a24ee5d573f715b403dfad0e5a582.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_90106bfb5b8fc1784a4a02741cd7f0c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_90106bfb5b8fc1784a4a02741cd7f0c1.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_23624e1424d192af52375291b285c04c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_23624e1424d192af52375291b285c04c.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_008c9ba096485305ae092dec033d8f01.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_008c9ba096485305ae092dec033d8f01.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_3bb3dd60f1b6fed3a398b13f8944905d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_3bb3dd60f1b6fed3a398b13f8944905d.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_ced072c26c08d3132540db63d6bb1a14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ced072c26c08d3132540db63d6bb1a14.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_0f483d0a0df46e457346bc5cc62caa03.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_0f483d0a0df46e457346bc5cc62caa03.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_a469dd073c84d98cbc3639ca2b8a0d4e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_a469dd073c84d98cbc3639ca2b8a0d4e.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_a52c9d6a879cd4317b54fb6cb1cfe877.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_a52c9d6a879cd4317b54fb6cb1cfe877.jpg already downloaded
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd4%252Fccd4fa8e513e0378b19598c6f1ee531e%252Fpa%252FRR01899_fdfbc713bc5258503229f471af18978e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_fdfbc713bc5258503229f471af18978e.jpg already downloaded
2025-12-05 17:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c7c8643d-4598-54a8-931a-03eb959fa2a9, identifier: RR01899
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c7c8643d-4598-54a8-931a-03eb959fa2a9 with identifier: RR01899
2025-12-05 17:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c7c8643d-4598-54a8-931a-03eb959fa2a9 with identifier: RR01899
2025-12-05 17:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c7c8643d-4598-54a8-931a-03eb959fa2a9 with identifier: RR01899 to the API
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RR01899>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:04:26Z',
'fuel_type': 'petrol',
'id': 'c7c8643d-4598-54a8-931a-03eb959fa2a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR01899',
'listing': 'auction',
'location': 'FR',
'make': 'BMW',
'model': 'X1',
'odometer': 47480,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_c7d3f9b50824271776043afaf87ddc33.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_65238a02357c17b7bea65dd2bf34c76b.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_68295a939bebd6c8849a17294092dbe6.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_0a963cb431e5ff638487023ec916a3d9.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_688b63e9c0e62692b7b70fcfc37db8d5.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ecacc0c2e4ce455ef35d45c846d2c3cf.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_90233b1d67989becf53b4149016d05d2.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ff5848c2ffb4e84b0d8cfb1335c1fd49.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_d0ad28a7a212a9895c1146797b980fe9.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_e7fb057635164ad35a7eb128ab5dca81.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_bd1a24ee5d573f715b403dfad0e5a582.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_90106bfb5b8fc1784a4a02741cd7f0c1.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_23624e1424d192af52375291b285c04c.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_008c9ba096485305ae092dec033d8f01.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_3bb3dd60f1b6fed3a398b13f8944905d.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ced072c26c08d3132540db63d6bb1a14.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_0f483d0a0df46e457346bc5cc62caa03.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_a469dd073c84d98cbc3639ca2b8a0d4e.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_a52c9d6a879cd4317b54fb6cb1cfe877.jpg',
'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_fdfbc713bc5258503229f471af18978e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_c7d3f9b50824271776043afaf87ddc33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_65238a02357c17b7bea65dd2bf34c76b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_68295a939bebd6c8849a17294092dbe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_0a963cb431e5ff638487023ec916a3d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_688b63e9c0e62692b7b70fcfc37db8d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ecacc0c2e4ce455ef35d45c846d2c3cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_90233b1d67989becf53b4149016d05d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ff5848c2ffb4e84b0d8cfb1335c1fd49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_d0ad28a7a212a9895c1146797b980fe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_e7fb057635164ad35a7eb128ab5dca81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_bd1a24ee5d573f715b403dfad0e5a582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_90106bfb5b8fc1784a4a02741cd7f0c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_23624e1424d192af52375291b285c04c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_008c9ba096485305ae092dec033d8f01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_3bb3dd60f1b6fed3a398b13f8944905d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_ced072c26c08d3132540db63d6bb1a14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22457,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_0f483d0a0df46e457346bc5cc62caa03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21797,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_a469dd073c84d98cbc3639ca2b8a0d4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_a52c9d6a879cd4317b54fb6cb1cfe877.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c8643d-4598-54a8-931a-03eb959fa2a9/c7c8643d-4598-54a8-931a-03eb959fa2a9_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/d4/ccd4fa8e513e0378b19598c6f1ee531e/pa/RR01899_fdfbc713bc5258503229f471af18978e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 20i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR01899%27 HTTP/1.1" 200 None
2025-12-05 17:00:46 [auto1.fr] INFO: Saving data for RR01899: {'created_time': 1764954046.357352, 'last_price_update_time': 1764954046.357363, 'auction_closing_time': 1765037066.0}
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RR01899') HTTP/1.1" 204 0
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_21b90284d4859bf69e001ae3011b03d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF24140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC41750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB34867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU00920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU53043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7c12190>
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_21b90284d4859bf69e001ae3011b03d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_21b90284d4859bf69e001ae3011b03d2.jpg saved to cache
2025-12-05 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_ba6975cb9f56290be9df70196946e4ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_d3a55062785462812e384c23993b791c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_808d950c89d63a30f3dd4bb9baab18e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5a857d5251c55ad2dcebb27aa1521fa2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5b0f529b04d3fee06216c5988f1ce640.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_89c224a84fae56d7d35e086d442275c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_c2e936000859b4e77322fbaf724f026f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_b53ce1aad32ea74b0d65ff06d39f4928.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f99f92406d9fca1fb65e95af7be543cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f1950>
2025-12-05 17:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_ba6975cb9f56290be9df70196946e4ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_ba6975cb9f56290be9df70196946e4ac.jpg saved to cache
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a0bed0>
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_d3a55062785462812e384c23993b791c.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_d3a55062785462812e384c23993b791c.jpg saved to cache
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB33063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7e890>
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_808d950c89d63a30f3dd4bb9baab18e5.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_808d950c89d63a30f3dd4bb9baab18e5.jpg saved to cache
2025-12-05 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5925050>
2025-12-05 17:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_5a857d5251c55ad2dcebb27aa1521fa2.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5a857d5251c55ad2dcebb27aa1521fa2.jpg saved to cache
2025-12-05 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9d350>
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_5b0f529b04d3fee06216c5988f1ce640.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5b0f529b04d3fee06216c5988f1ce640.jpg saved to cache
2025-12-05 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea1e90>
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_89c224a84fae56d7d35e086d442275c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_89c224a84fae56d7d35e086d442275c5.jpg saved to cache
2025-12-05 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e83a50>
2025-12-05 17:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_c2e936000859b4e77322fbaf724f026f.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_c2e936000859b4e77322fbaf724f026f.jpg saved to cache
2025-12-05 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57efc90>
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_b53ce1aad32ea74b0d65ff06d39f4928.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_b53ce1aad32ea74b0d65ff06d39f4928.jpg saved to cache
2025-12-05 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a8b3d0>
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_f99f92406d9fca1fb65e95af7be543cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f99f92406d9fca1fb65e95af7be543cb.jpg saved to cache
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL86613> (referer: https://www.auto1.com/v1/car-details-view/TL86613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK15612> (referer: https://www.auto1.com/v1/car-details-view/HK15612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX70763> (referer: https://www.auto1.com/v1/car-details-view/DX70763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB27704> (referer: https://www.auto1.com/v1/car-details-view/UB27704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_66b3dac81650a10c80e2e5bbc9d1ed07.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_3d53dc8bfdbb2a60ef29963f318b584c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0cf37a-98d9-537c-80b2-6aa1144f2812 with identifier: TL86613
2025-12-05 17:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0cf37a-98d9-537c-80b2-6aa1144f2812 with scrape type 2
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0cf37a-98d9-537c-80b2-6aa1144f2812 with scrape type 2
2025-12-05 17:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f0cf37a-98d9-537c-80b2-6aa1144f2812, identifier: TL86613
2025-12-05 17:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd08c006-0998-5f09-a4f3-c26aa44f10a5 with identifier: HK15612
2025-12-05 17:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd08c006-0998-5f09-a4f3-c26aa44f10a5 with scrape type 1
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item cd08c006-0998-5f09-a4f3-c26aa44f10a5
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_27da30059474fff639ae9ebbf2ee0e12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_27da30059474fff639ae9ebbf2ee0e12.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_f7b289bc747f53900e4888a58e3396e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_f7b289bc747f53900e4888a58e3396e8.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_01f4efd517856955e6dfc3457c8af72c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_01f4efd517856955e6dfc3457c8af72c.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_fcd1573e00882321cadc732993b7f734.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_fcd1573e00882321cadc732993b7f734.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_aeef4d8e86a873397e96996c0b984973.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_aeef4d8e86a873397e96996c0b984973.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_9603568864c72e5957c2cdfeb8688672.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_9603568864c72e5957c2cdfeb8688672.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_221d66658100f2f350a2ddde7c07c6e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_221d66658100f2f350a2ddde7c07c6e4.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_d2576388fdbb5dd67a204cd0db43d670.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_d2576388fdbb5dd67a204cd0db43d670.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_22a1969cb7675f0d87a257dafac9491f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_22a1969cb7675f0d87a257dafac9491f.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_93bc11d6bb1c48928d795351c44f7e56.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_93bc11d6bb1c48928d795351c44f7e56.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_6c4cd5bd634e5042c82937d9c6bdc7b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_6c4cd5bd634e5042c82937d9c6bdc7b0.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_2a15b1bea3cdd4ce1a4ae62da47604a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_2a15b1bea3cdd4ce1a4ae62da47604a6.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_4cde02630d570940cb7957ea67a3020c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_4cde02630d570940cb7957ea67a3020c.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_6c0ed0021a8b2ee25706b20049a9bd19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_6c0ed0021a8b2ee25706b20049a9bd19.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_be487c41e331d542ba301fa5d10f27fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_be487c41e331d542ba301fa5d10f27fe.jpg already downloaded
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff1%252F6ef15008a9c3de7374f1f7aec3d721d9%252Fpa%252FHK15612_300c581023319ae7e05db57216e20cbb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_300c581023319ae7e05db57216e20cbb.jpg already downloaded
2025-12-05 17:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd08c006-0998-5f09-a4f3-c26aa44f10a5, identifier: HK15612
2025-12-05 17:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f0cf37a-98d9-537c-80b2-6aa1144f2812 with identifier: TL86613
2025-12-05 17:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f0cf37a-98d9-537c-80b2-6aa1144f2812 with identifier: TL86613
2025-12-05 17:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f0cf37a-98d9-537c-80b2-6aa1144f2812 with identifier: TL86613 to the API
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TL86613>
{'auction_title': '',
'c_o_2_emission_value': 78,
'category': 'Taxi',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2025-12-06T16:14:22Z',
'fuel_type': 'hybrid',
'id': '7f0cf37a-98d9-537c-80b2-6aa1144f2812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL86613',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Toyota',
'model': 'Prius',
'odometer': 97618,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Prius 1.8 Hybrid Dynamic Pack Premium Business',
'transmission': 'automatic',
'trim': 'Dynamic Pack Premium Business',
'year': 2019}
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL86613%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [auto1.fr] INFO: Saving data for TL86613: {'auction_closing_time': 1765037662.0, 'created_time': 1764436536.312409, 'last_price_update_time': 1764954051.082163}
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL86613') HTTP/1.1" 204 0
2025-12-05 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd08c006-0998-5f09-a4f3-c26aa44f10a5 with identifier: HK15612
2025-12-05 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd08c006-0998-5f09-a4f3-c26aa44f10a5 with identifier: HK15612
2025-12-05 17:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd08c006-0998-5f09-a4f3-c26aa44f10a5 with identifier: HK15612 to the API
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK15612>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:20:12Z',
'fuel_type': 'petrol',
'id': 'cd08c006-0998-5f09-a4f3-c26aa44f10a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK15612',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 54371,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_27da30059474fff639ae9ebbf2ee0e12.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_f7b289bc747f53900e4888a58e3396e8.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_01f4efd517856955e6dfc3457c8af72c.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_fcd1573e00882321cadc732993b7f734.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_aeef4d8e86a873397e96996c0b984973.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_9603568864c72e5957c2cdfeb8688672.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_221d66658100f2f350a2ddde7c07c6e4.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_d2576388fdbb5dd67a204cd0db43d670.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_22a1969cb7675f0d87a257dafac9491f.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_93bc11d6bb1c48928d795351c44f7e56.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_6c4cd5bd634e5042c82937d9c6bdc7b0.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_2a15b1bea3cdd4ce1a4ae62da47604a6.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_4cde02630d570940cb7957ea67a3020c.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_6c0ed0021a8b2ee25706b20049a9bd19.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_be487c41e331d542ba301fa5d10f27fe.jpg',
'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_300c581023319ae7e05db57216e20cbb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_27da30059474fff639ae9ebbf2ee0e12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_f7b289bc747f53900e4888a58e3396e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_01f4efd517856955e6dfc3457c8af72c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_fcd1573e00882321cadc732993b7f734.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_aeef4d8e86a873397e96996c0b984973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_9603568864c72e5957c2cdfeb8688672.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_221d66658100f2f350a2ddde7c07c6e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_d2576388fdbb5dd67a204cd0db43d670.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_22a1969cb7675f0d87a257dafac9491f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69295,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_93bc11d6bb1c48928d795351c44f7e56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_6c4cd5bd634e5042c82937d9c6bdc7b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_2a15b1bea3cdd4ce1a4ae62da47604a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2766996,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_4cde02630d570940cb7957ea67a3020c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_6c0ed0021a8b2ee25706b20049a9bd19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_be487c41e331d542ba301fa5d10f27fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd08c006-0998-5f09-a4f3-c26aa44f10a5/cd08c006-0998-5f09-a4f3-c26aa44f10a5_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f1/6ef15008a9c3de7374f1f7aec3d721d9/pa/HK15612_300c581023319ae7e05db57216e20cbb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
'transmission': 'automatic',
'trim': 'SportLine',
'year': 2021}
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK15612%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [auto1.fr] INFO: Saving data for HK15612: {'created_time': 1764954051.38777, 'last_price_update_time': 1764954051.387779, 'auction_closing_time': 1765038012.0}
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK15612') HTTP/1.1" 204 0
2025-12-05 17:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19de188b-c5c0-5ac5-b31c-3d9b73865e39 with identifier: DX70763
2025-12-05 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19de188b-c5c0-5ac5-b31c-3d9b73865e39 with scrape type 2
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19de188b-c5c0-5ac5-b31c-3d9b73865e39 with scrape type 2
2025-12-05 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19de188b-c5c0-5ac5-b31c-3d9b73865e39, identifier: DX70763
2025-12-05 17:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747d9369-fdf3-535b-8d87-07b9fcb69d34 with identifier: UB27704
2025-12-05 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747d9369-fdf3-535b-8d87-07b9fcb69d34 with scrape type 1
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 747d9369-fdf3-535b-8d87-07b9fcb69d34
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_85ccd706a5ae2a0732386370e00d01c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_85ccd706a5ae2a0732386370e00d01c1.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_f1e9af3aa4f6b86b65710e2d90ed07a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_f1e9af3aa4f6b86b65710e2d90ed07a2.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_c713e6eb224b881f1f7b746c9b267407.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_c713e6eb224b881f1f7b746c9b267407.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_3a9c1a9a74a5f1b8aa2fbb869540102d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_3a9c1a9a74a5f1b8aa2fbb869540102d.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_4dac3988a0b203ef14fd6607cbfc74ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_4dac3988a0b203ef14fd6607cbfc74ae.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_b7aa6ad950c5b889e6988da6b7362950.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_b7aa6ad950c5b889e6988da6b7362950.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_9c33b72924fd25a0e7eb0f1fd0447b39.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_9c33b72924fd25a0e7eb0f1fd0447b39.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_9f76ef4ffffb3e9629b8a04bc58f19f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_9f76ef4ffffb3e9629b8a04bc58f19f7.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_818fd00725e3f7f6f3c7f45b16eca0c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_818fd00725e3f7f6f3c7f45b16eca0c1.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_8970211e353d0ccad06cc4ef2476f322.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_8970211e353d0ccad06cc4ef2476f322.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_d66db448b398cf3f238108d9fbe06f90.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_d66db448b398cf3f238108d9fbe06f90.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_db2aab269ef8d7b635f19093c72ee2af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_db2aab269ef8d7b635f19093c72ee2af.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_2d129b06fb92b475cb4ba326c4a496e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_2d129b06fb92b475cb4ba326c4a496e4.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_2fe513b027e022a88f05c1124beb35a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_2fe513b027e022a88f05c1124beb35a7.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_04a320b977d4da1e17816571ff2f7769.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_04a320b977d4da1e17816571ff2f7769.jpg already downloaded
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F40%252F4740fe58b34c0134323c3bf8f85cbf8a%252Fpa%252FUB27704_7dce3352fb4f87f28ac9f0e0718acf9d.png%27 HTTP/1.1" 200 None
2025-12-05 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_7dce3352fb4f87f28ac9f0e0718acf9d.png already downloaded
2025-12-05 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 747d9369-fdf3-535b-8d87-07b9fcb69d34, identifier: UB27704
2025-12-05 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19de188b-c5c0-5ac5-b31c-3d9b73865e39 with identifier: DX70763
2025-12-05 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19de188b-c5c0-5ac5-b31c-3d9b73865e39 with identifier: DX70763
2025-12-05 17:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19de188b-c5c0-5ac5-b31c-3d9b73865e39 with identifier: DX70763 to the API
2025-12-05 17:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX70763>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:23:19Z',
'fuel_type': 'diesel',
'id': '19de188b-c5c0-5ac5-b31c-3d9b73865e39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX70763',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 133474,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi N-Connecta',
'transmission': 'automatic',
'trim': 'N-Connecta',
'year': 2020}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX70763%27 HTTP/1.1" 200 None
2025-12-05 17:00:52 [auto1.fr] INFO: Saving data for DX70763: {'auction_closing_time': 1765038199.0, 'created_time': 1764756040.254326, 'last_price_update_time': 1764954052.180859}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DX70763') HTTP/1.1" 204 0
2025-12-05 17:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 747d9369-fdf3-535b-8d87-07b9fcb69d34 with identifier: UB27704
2025-12-05 17:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 747d9369-fdf3-535b-8d87-07b9fcb69d34 with identifier: UB27704
2025-12-05 17:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 747d9369-fdf3-535b-8d87-07b9fcb69d34 with identifier: UB27704 to the API
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB27704>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 160,
'expiration_date': '2025-12-06T16:46:59Z',
'fuel_type': 'diesel',
'id': '747d9369-fdf3-535b-8d87-07b9fcb69d34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB27704',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 127464,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_85ccd706a5ae2a0732386370e00d01c1.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_f1e9af3aa4f6b86b65710e2d90ed07a2.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_c713e6eb224b881f1f7b746c9b267407.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_3a9c1a9a74a5f1b8aa2fbb869540102d.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_4dac3988a0b203ef14fd6607cbfc74ae.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_b7aa6ad950c5b889e6988da6b7362950.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_9c33b72924fd25a0e7eb0f1fd0447b39.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_9f76ef4ffffb3e9629b8a04bc58f19f7.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_818fd00725e3f7f6f3c7f45b16eca0c1.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_8970211e353d0ccad06cc4ef2476f322.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_d66db448b398cf3f238108d9fbe06f90.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_db2aab269ef8d7b635f19093c72ee2af.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_2d129b06fb92b475cb4ba326c4a496e4.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_2fe513b027e022a88f05c1124beb35a7.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_04a320b977d4da1e17816571ff2f7769.jpg',
'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_7dce3352fb4f87f28ac9f0e0718acf9d.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_85ccd706a5ae2a0732386370e00d01c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_f1e9af3aa4f6b86b65710e2d90ed07a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_c713e6eb224b881f1f7b746c9b267407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_3a9c1a9a74a5f1b8aa2fbb869540102d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_4dac3988a0b203ef14fd6607cbfc74ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_b7aa6ad950c5b889e6988da6b7362950.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_9c33b72924fd25a0e7eb0f1fd0447b39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2458880,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_9f76ef4ffffb3e9629b8a04bc58f19f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_818fd00725e3f7f6f3c7f45b16eca0c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_8970211e353d0ccad06cc4ef2476f322.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_d66db448b398cf3f238108d9fbe06f90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_db2aab269ef8d7b635f19093c72ee2af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_2d129b06fb92b475cb4ba326c4a496e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_2fe513b027e022a88f05c1124beb35a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_04a320b977d4da1e17816571ff2f7769.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d9369-fdf3-535b-8d87-07b9fcb69d34/747d9369-fdf3-535b-8d87-07b9fcb69d34_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77763,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img47/40/4740fe58b34c0134323c3bf8f85cbf8a/pa/UB27704_7dce3352fb4f87f28ac9f0e0718acf9d.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2019}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB27704%27 HTTP/1.1" 200 None
2025-12-05 17:00:52 [auto1.fr] INFO: Saving data for UB27704: {'created_time': 1764954052.526443, 'last_price_update_time': 1764954052.526453, 'auction_closing_time': 1765039619.0}
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB27704') HTTP/1.1" 204 0
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF24140> (referer: https://www.auto1.com/v1/car-details-view/FF24140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU53043> (referer: https://www.auto1.com/v1/car-details-view/GU53043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS06014> (referer: https://www.auto1.com/v1/car-details-view/SS06014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592c750>
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_66b3dac81650a10c80e2e5bbc9d1ed07.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_66b3dac81650a10c80e2e5bbc9d1ed07.jpg saved to cache
2025-12-05 17:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57e79d0>
2025-12-05 17:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_3d53dc8bfdbb2a60ef29963f318b584c.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_3d53dc8bfdbb2a60ef29963f318b584c.jpg saved to cache
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189a95be-4618-536e-9804-667d96159ec2 with identifier: FF24140
2025-12-05 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189a95be-4618-536e-9804-667d96159ec2 with scrape type 1
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg not downloaded yet
2025-12-05 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff with identifier: GU53043
2025-12-05 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff with scrape type 2
2025-12-05 17:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff, identifier: GU53043
2025-12-05 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59f84090-3131-59a1-b11e-9d7e3aec996a with identifier: SS06014
2025-12-05 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59f84090-3131-59a1-b11e-9d7e3aec996a with scrape type 1
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 59f84090-3131-59a1-b11e-9d7e3aec996a
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_e09762bb4690404a7206960a88170e8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_31156d49938f850f6152998b2beae8cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_d8356ba35de747be2b391495fd003eea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_6ba883741f3a532ab280076d08523661.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_606042ad6709b7d66b4935f04590ba72.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_f536dc90b748594634280b4159384743.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_46686ee67c4069c1c1a1785b59802a09.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_289692be39609faae25699eff707fc68.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg already downloaded
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F2d%252Fad2d484344c603495e3d38b2b9a10a1d%252Fpa%252FSS06014_efa1b1038d5abb9aca491ffa1d385b4a.png%27 HTTP/1.1" 200 None
2025-12-05 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png already downloaded
2025-12-05 17:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59f84090-3131-59a1-b11e-9d7e3aec996a, identifier: SS06014
2025-12-05 17:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff with identifier: GU53043
2025-12-05 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff with identifier: GU53043
2025-12-05 17:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff with identifier: GU53043 to the API
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GU53043>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 265,
'expiration_date': '2025-12-06T16:23:31Z',
'fuel_type': 'hybrid',
'id': '0fb73f30-b9b0-5ab7-a78d-0bbb926b73ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU53043',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 82257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Creative 4WD',
'transmission': 'automatic',
'trim': 'Creative 4WD',
'year': 2021}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU53043%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [auto1.fr] INFO: Saving data for GU53043: {'auction_closing_time': 1765038211.0, 'created_time': 1761206463.276646, 'last_price_update_time': 1764954054.291289}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU53043') HTTP/1.1" 204 0
2025-12-05 17:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59f84090-3131-59a1-b11e-9d7e3aec996a with identifier: SS06014
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59f84090-3131-59a1-b11e-9d7e3aec996a with identifier: SS06014
2025-12-05 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 33252, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ss06014', 'expiration_date': '2025-12-06t16:26:07z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png'], 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '59f84090-3131-59a1-b11e-9d7e3aec996a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68168}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60978}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68395}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59235}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70243}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69756}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73944}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60317}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88033}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 78913}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 33252}
Failed validating None in schema:
False
On instance:
{'age_in_months': 41,
'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'orange',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:26:07z',
'fuel_type': 'petrol',
'id': '59f84090-3131-59a1-b11e-9d7e3aec996a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ss06014',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 33252,
'odometer_in_km': 33252,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 78913,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-05',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2022}
2025-12-05 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 59f84090-3131-59a1-b11e-9d7e3aec996a spider: auto1.fr
2025-12-05 17:00:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 59f84090-3131-59a1-b11e-9d7e3aec996a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 33252, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ss06014', 'expiration_date': '2025-12-06t16:26:07z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg', 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png'], 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '59f84090-3131-59a1-b11e-9d7e3aec996a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68168}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60978}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68395}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59235}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70243}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69756}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73944}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60317}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88033}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 78913}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 33252}
Failed validating None in schema:
False
On instance:
{'age_in_months': 41,
'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'orange',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:26:07z',
'fuel_type': 'petrol',
'id': '59f84090-3131-59a1-b11e-9d7e3aec996a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ss06014',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 33252,
'odometer_in_km': 33252,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 78913,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-05',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:26:07Z',
'fuel_type': 'petrol',
'id': '59f84090-3131-59a1-b11e-9d7e3aec996a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS06014',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '2008',
'odometer': 33252,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg',
'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b3d3bc35f3d9ce94c82584471bcfa1d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_9ed37c122c9da20e342c9d62a5e6d384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_0d6c09f759b99aab432aad45a66ccd9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_e09762bb4690404a7206960a88170e8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_8eb6869c3b76994c641a4c32e9d87aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_31156d49938f850f6152998b2beae8cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_d8356ba35de747be2b391495fd003eea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_6ba883741f3a532ab280076d08523661.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_606042ad6709b7d66b4935f04590ba72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_587e6af7b86d9becfd69b967c6cd9ad8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_b0c36d22cece9c6e320c29a1d40d13ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_f536dc90b748594634280b4159384743.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_a0c30dcda5d3d2e49ea901b399a013f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_46686ee67c4069c1c1a1785b59802a09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_289692be39609faae25699eff707fc68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59f84090-3131-59a1-b11e-9d7e3aec996a/59f84090-3131-59a1-b11e-9d7e3aec996a_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 78913,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgad/2d/ad2d484344c603495e3d38b2b9a10a1d/pa/SS06014_efa1b1038d5abb9aca491ffa1d385b4a.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2022}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS06014%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [auto1.fr] INFO: Saving data for SS06014: {'created_time': 1764954054.693606, 'last_price_update_time': 1764954054.693616, 'auction_closing_time': 1765038367.0}
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SS06014') HTTP/1.1" 204 0
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_081dfca1fb3315e86eb4c3225d633016.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg not downloaded yet
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU00920> (referer: https://www.auto1.com/v1/car-details-view/FU00920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS84396> (referer: https://www.auto1.com/v1/car-details-view/PS84396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC41750> (referer: https://www.auto1.com/v1/car-details-view/KC41750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB34867> (referer: https://www.auto1.com/v1/car-details-view/WB34867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX88160> (referer: https://www.auto1.com/v1/car-details-view/AX88160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_fcee4781da0a19d0118d512db473ec79.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8d6b53a0753451ff081a075290e74fae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg not downloaded yet
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_4603edddd273d9c538f7b0882d83728a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_9b0393e0be98578157a64cf9b18b7427.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg not downloaded yet
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_b960e94713f3696bd20588e4fcf184f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg not downloaded yet
2025-12-05 17:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5be0101-bb09-579f-9f51-3620cabcfb35 with identifier: FU00920
2025-12-05 17:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5be0101-bb09-579f-9f51-3620cabcfb35 with scrape type 2
2025-12-05 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5be0101-bb09-579f-9f51-3620cabcfb35 with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5be0101-bb09-579f-9f51-3620cabcfb35, identifier: FU00920
2025-12-05 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e781090-f217-5983-9ffa-91dee2e1b7e1 with identifier: PS84396
2025-12-05 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e781090-f217-5983-9ffa-91dee2e1b7e1 with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e781090-f217-5983-9ffa-91dee2e1b7e1 with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e781090-f217-5983-9ffa-91dee2e1b7e1, identifier: PS84396
2025-12-05 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c09544-d2a7-5c0c-9b01-70aa1d920b4b with identifier: KC41750
2025-12-05 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c09544-d2a7-5c0c-9b01-70aa1d920b4b with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2c09544-d2a7-5c0c-9b01-70aa1d920b4b with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2c09544-d2a7-5c0c-9b01-70aa1d920b4b, identifier: KC41750
2025-12-05 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4983170a-b254-5d7b-8dd9-feb1250de9df with identifier: WB34867
2025-12-05 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4983170a-b254-5d7b-8dd9-feb1250de9df with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4983170a-b254-5d7b-8dd9-feb1250de9df with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4983170a-b254-5d7b-8dd9-feb1250de9df, identifier: WB34867
2025-12-05 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8733e2bb-7057-506d-8b05-548b7529f8b2 with identifier: AX88160
2025-12-05 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8733e2bb-7057-506d-8b05-548b7529f8b2 with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8733e2bb-7057-506d-8b05-548b7529f8b2 with scrape type 2
2025-12-05 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8733e2bb-7057-506d-8b05-548b7529f8b2, identifier: AX88160
2025-12-05 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5be0101-bb09-579f-9f51-3620cabcfb35 with identifier: FU00920
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5be0101-bb09-579f-9f51-3620cabcfb35 with identifier: FU00920
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 48168, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu00920', 'expiration_date': '2025-12-06t16:10:29z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'narbonne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'c5be0101-bb09-579f-9f51-3620cabcfb35', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 48168}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:10:29z',
'fuel_type': 'petrol',
'id': 'c5be0101-bb09-579f-9f51-3620cabcfb35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu00920',
'listing': 'auction',
'location': 'narbonne',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 48168,
'odometer_in_km': 48168,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-02',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech graphic',
'transmission': 'manual',
'trim': 'graphic',
'year': 2019}
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c5be0101-bb09-579f-9f51-3620cabcfb35 spider: auto1.fr
2025-12-05 17:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c5be0101-bb09-579f-9f51-3620cabcfb35 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 48168, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu00920', 'expiration_date': '2025-12-06t16:10:29z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'narbonne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'c5be0101-bb09-579f-9f51-3620cabcfb35', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 48168}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:10:29z',
'fuel_type': 'petrol',
'id': 'c5be0101-bb09-579f-9f51-3620cabcfb35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu00920',
'listing': 'auction',
'location': 'narbonne',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 48168,
'odometer_in_km': 48168,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-02',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech graphic',
'transmission': 'manual',
'trim': 'graphic',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:10:29Z',
'fuel_type': 'petrol',
'id': 'c5be0101-bb09-579f-9f51-3620cabcfb35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU00920',
'listing': 'auction',
'location': 'Narbonne',
'make': 'Citroen',
'model': 'C3',
'odometer': 48168,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Graphic',
'transmission': 'manual',
'trim': 'Graphic',
'year': 2019}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU00920%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [auto1.fr] INFO: Saving data for FU00920: {'auction_closing_time': 1765037429.0, 'created_time': 1764756434.941991, 'last_price_update_time': 1764954055.68216}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FU00920') HTTP/1.1" 204 0
2025-12-05 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e781090-f217-5983-9ffa-91dee2e1b7e1 with identifier: PS84396
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e781090-f217-5983-9ffa-91dee2e1b7e1 with identifier: PS84396
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191107 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191107
2025-12-05 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7e781090-f217-5983-9ffa-91dee2e1b7e1 spider: auto1.fr
2025-12-05 17:00:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7e781090-f217-5983-9ffa-91dee2e1b7e1 due to rule: high_mileage_for_country.json, error: 191107 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
191107
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:38:34Z',
'fuel_type': 'diesel',
'id': '7e781090-f217-5983-9ffa-91dee2e1b7e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS84396',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 191107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-21',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2017}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS84396%27 HTTP/1.1" 200 None
2025-12-05 17:00:55 [auto1.fr] INFO: Saving data for PS84396: {'auction_closing_time': 1765039114.0, 'created_time': 1764756039.53023, 'last_price_update_time': 1764954055.917005}
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS84396') HTTP/1.1" 204 0
2025-12-05 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2c09544-d2a7-5c0c-9b01-70aa1d920b4b with identifier: KC41750
2025-12-05 17:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2025-12-05 17:00:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2c09544-d2a7-5c0c-9b01-70aa1d920b4b with identifier: KC41750
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 44032, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kc41750', 'expiration_date': '2025-12-06t16:55:21z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, montataire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 122, 'id': 'a2c09544-d2a7-5c0c-9b01-70aa1d920b4b', 'current_year_diff': 2, 'age_in_months': 34, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 44032}
Failed validating None in schema:
False
On instance:
{'age_in_months': 34,
'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'yellow',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:55:21z',
'fuel_type': 'petrol',
'id': 'a2c09544-d2a7-5c0c-9b01-70aa1d920b4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kc41750',
'listing': 'auction',
'location': 'fr, montataire',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 44032,
'odometer_in_km': 44032,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a2c09544-d2a7-5c0c-9b01-70aa1d920b4b spider: auto1.fr
2025-12-05 17:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a2c09544-d2a7-5c0c-9b01-70aa1d920b4b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 44032, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kc41750', 'expiration_date': '2025-12-06t16:55:21z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, montataire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 122, 'id': 'a2c09544-d2a7-5c0c-9b01-70aa1d920b4b', 'current_year_diff': 2, 'age_in_months': 34, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 44032}
Failed validating None in schema:
False
On instance:
{'age_in_months': 34,
'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'yellow',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:55:21z',
'fuel_type': 'petrol',
'id': 'a2c09544-d2a7-5c0c-9b01-70aa1d920b4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kc41750',
'listing': 'auction',
'location': 'fr, montataire',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 44032,
'odometer_in_km': 44032,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:55:21Z',
'fuel_type': 'petrol',
'id': 'a2c09544-d2a7-5c0c-9b01-70aa1d920b4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC41750',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Peugeot',
'model': '208',
'odometer': 44032,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC41750%27 HTTP/1.1" 200 None
2025-12-05 17:00:56 [auto1.fr] INFO: Saving data for KC41750: {'auction_closing_time': 1765040121.0, 'created_time': 1764756189.614778, 'last_price_update_time': 1764954056.35296}
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KC41750') HTTP/1.1" 204 0
2025-12-05 17:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4983170a-b254-5d7b-8dd9-feb1250de9df with identifier: WB34867
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4983170a-b254-5d7b-8dd9-feb1250de9df with identifier: WB34867
2025-12-05 17:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4983170a-b254-5d7b-8dd9-feb1250de9df with identifier: WB34867 to the API
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB34867>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:20:21Z',
'fuel_type': 'diesel',
'id': '4983170a-b254-5d7b-8dd9-feb1250de9df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB34867',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'Seat',
'model': 'Arona',
'odometer': 113385,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-01',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB34867%27 HTTP/1.1" 200 None
2025-12-05 17:00:56 [auto1.fr] INFO: Saving data for WB34867: {'auction_closing_time': 1765038021.0, 'created_time': 1764756418.835574, 'last_price_update_time': 1764954056.738887}
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB34867') HTTP/1.1" 204 0
2025-12-05 17:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8733e2bb-7057-506d-8b05-548b7529f8b2 with identifier: AX88160
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8733e2bb-7057-506d-8b05-548b7529f8b2 with identifier: AX88160
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 116091, 'odometer_reading_unit': 'km', 'registration_date': '2016-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ax88160', 'expiration_date': '2025-12-06t16:12:17z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '8733e2bb-7057-506d-8b05-548b7529f8b2', 'current_year_diff': 9, 'age_in_months': 113, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 116091}
Failed validating None in schema:
False
On instance:
{'age_in_months': 113,
'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:12:17z',
'fuel_type': 'petrol',
'id': '8733e2bb-7057-506d-8b05-548b7529f8b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ax88160',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 116091,
'odometer_in_km': 116091,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2016}
2025-12-05 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8733e2bb-7057-506d-8b05-548b7529f8b2 spider: auto1.fr
2025-12-05 17:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8733e2bb-7057-506d-8b05-548b7529f8b2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 116091, 'odometer_reading_unit': 'km', 'registration_date': '2016-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ax88160', 'expiration_date': '2025-12-06t16:12:17z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '8733e2bb-7057-506d-8b05-548b7529f8b2', 'current_year_diff': 9, 'age_in_months': 113, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 116091}
Failed validating None in schema:
False
On instance:
{'age_in_months': 113,
'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:12:17z',
'fuel_type': 'petrol',
'id': '8733e2bb-7057-506d-8b05-548b7529f8b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ax88160',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 116091,
'odometer_in_km': 116091,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:12:17Z',
'fuel_type': 'petrol',
'id': '8733e2bb-7057-506d-8b05-548b7529f8b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX88160',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Peugeot',
'model': '2008',
'odometer': 116091,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2025-12-05 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX88160%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [auto1.fr] INFO: Saving data for AX88160: {'auction_closing_time': 1765037537.0, 'created_time': 1764410439.093518, 'last_price_update_time': 1764954057.023373}
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX88160') HTTP/1.1" 204 0
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_549bbe3daffc229b4b999bec9642ad53.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg not downloaded yet
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX96803> (referer: https://www.auto1.com/v1/car-details-view/PX96803/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_d7a6088026e4959e08323f34a68bb357.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg not downloaded yet
2025-12-05 17:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM41616> (referer: https://www.auto1.com/v1/car-details-view/JM41616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF22806> (referer: https://www.auto1.com/v1/car-details-view/GF22806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f0c10>
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg saved to cache
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5975790>
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg saved to cache
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg not downloaded yet
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8924c01d8baed399e77d84f38df4f5b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg not downloaded yet
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9d510>
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg saved to cache
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a5410>
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8d6b53a0753451ff081a075290e74fae.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg saved to cache
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42de086-e785-566b-bdff-b84d2571cf1c with identifier: PX96803
2025-12-05 17:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42de086-e785-566b-bdff-b84d2571cf1c with scrape type 2
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e42de086-e785-566b-bdff-b84d2571cf1c with scrape type 2
2025-12-05 17:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e42de086-e785-566b-bdff-b84d2571cf1c, identifier: PX96803
2025-12-05 17:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616
2025-12-05 17:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2575aca-b3c4-5f8e-a524-e09036092fdb with scrape type 2
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2575aca-b3c4-5f8e-a524-e09036092fdb with scrape type 2
2025-12-05 17:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2575aca-b3c4-5f8e-a524-e09036092fdb, identifier: JM41616
2025-12-05 17:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff9e8d7-a3b7-5543-982d-b7626dec0154 with identifier: GF22806
2025-12-05 17:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff9e8d7-a3b7-5543-982d-b7626dec0154 with scrape type 2
2025-12-05 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ff9e8d7-a3b7-5543-982d-b7626dec0154 with scrape type 2
2025-12-05 17:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ff9e8d7-a3b7-5543-982d-b7626dec0154, identifier: GF22806
2025-12-05 17:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e42de086-e785-566b-bdff-b84d2571cf1c with identifier: PX96803
2025-12-05 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e42de086-e785-566b-bdff-b84d2571cf1c with identifier: PX96803
2025-12-05 17:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e42de086-e785-566b-bdff-b84d2571cf1c with identifier: PX96803 to the API
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX96803>
{'auction_title': '',
'c_o_2_emission_value': 25,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 204,
'expiration_date': '2025-12-06T16:03:32Z',
'fuel_type': 'hybrid',
'id': 'e42de086-e785-566b-bdff-b84d2571cf1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX96803',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Seat',
'model': 'Leon',
'odometer': 119938,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-01',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.4 TSI e-HYBRID Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2021}
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX96803%27 HTTP/1.1" 200 None
2025-12-05 17:00:58 [auto1.fr] INFO: Saving data for PX96803: {'auction_closing_time': 1765037012.0, 'created_time': 1764842668.668398, 'last_price_update_time': 1764954058.920117}
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX96803') HTTP/1.1" 204 0
2025-12-05 17:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616
2025-12-05 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616
2025-12-05 17:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616 to the API
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM41616>
{'auction_title': '',
'c_o_2_emission_value': 47,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2025-12-06T16:31:55Z',
'fuel_type': 'hybrid',
'id': 'e2575aca-b3c4-5f8e-a524-e09036092fdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM41616',
'listing': 'auction',
'location': 'Seynod',
'make': 'BMW',
'model': 'X3',
'odometer': 130089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM41616%27 HTTP/1.1" 200 None
2025-12-05 17:00:59 [auto1.fr] INFO: Saving data for JM41616: {'auction_closing_time': 1765038715.0, 'created_time': 1764842532.829514, 'last_price_update_time': 1764954059.30351}
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM41616') HTTP/1.1" 204 0
2025-12-05 17:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ff9e8d7-a3b7-5543-982d-b7626dec0154 with identifier: GF22806
2025-12-05 17:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ff9e8d7-a3b7-5543-982d-b7626dec0154 with identifier: GF22806
2025-12-05 17:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ff9e8d7-a3b7-5543-982d-b7626dec0154 with identifier: GF22806 to the API
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF22806>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': 'Taxi',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:30:58Z',
'fuel_type': 'hybrid',
'id': '6ff9e8d7-a3b7-5543-982d-b7626dec0154',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF22806',
'listing': 'auction',
'location': 'Saint-Denis',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 27127,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-15',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Trail',
'transmission': 'automatic',
'trim': 'Trail',
'year': 2023}
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF22806%27 HTTP/1.1" 200 None
2025-12-05 17:00:59 [auto1.fr] INFO: Saving data for GF22806: {'auction_closing_time': 1765038658.0, 'created_time': 1764842782.578515, 'last_price_update_time': 1764954059.620944}
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF22806') HTTP/1.1" 204 0
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg not downloaded yet
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL32967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB59403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM92526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX84073> (referer: https://www.auto1.com/v1/car-details-view/FX84073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB33063> (referer: https://www.auto1.com/v1/car-details-view/JB33063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb06d0>
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_9b0393e0be98578157a64cf9b18b7427.jpg') HTTP/1.1" 204 0
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg saved to cache
2025-12-05 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ab4d0>
2025-12-05 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_b960e94713f3696bd20588e4fcf184f8.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg saved to cache
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_1dccf620ecc469149a46530393f00be2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_4aec9d8c825694f77a85824b27d4e795.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg not downloaded yet
2025-12-05 17:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_547460aca5105e4a99273a69e71feb1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_88c027298f6de59497b148ad3e696092.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg not downloaded yet
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ee6010>
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg saved to cache
2025-12-05 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d63ed0>
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_4603edddd273d9c538f7b0882d83728a.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg saved to cache
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d659d0>
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_549bbe3daffc229b4b999bec9642ad53.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg saved to cache
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af997043-a2fc-5b8b-ae37-429abdcfc376 with identifier: FX84073
2025-12-05 17:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af997043-a2fc-5b8b-ae37-429abdcfc376 with scrape type 1
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item af997043-a2fc-5b8b-ae37-429abdcfc376
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_94fd5f15c6c1e94f46737246a69cab85.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_94fd5f15c6c1e94f46737246a69cab85.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_bf56d94f1579496aedc2be90c7fea428.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_bf56d94f1579496aedc2be90c7fea428.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_960125a5775326f94c2deff246fc548a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_960125a5775326f94c2deff246fc548a.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_daea3d9b371108ba4fd485739b11d4c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_daea3d9b371108ba4fd485739b11d4c4.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_9b1eb5f38ece415a901da1f0ffe96f16.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_9b1eb5f38ece415a901da1f0ffe96f16.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_77ac35a59a18a5818f7075bba0d97838.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_77ac35a59a18a5818f7075bba0d97838.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_7625d3eded83fae48301daa23383e8e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7625d3eded83fae48301daa23383e8e4.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_7bf163a0e03cfbb7666911e4afd8c54c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7bf163a0e03cfbb7666911e4afd8c54c.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_7ff0fda179732108a3465a32db5dcec1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7ff0fda179732108a3465a32db5dcec1.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_6c6c56998615626d4f117f939222d5ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_6c6c56998615626d4f117f939222d5ea.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_874c9a97036d509fcce8d1d18fc51a14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_874c9a97036d509fcce8d1d18fc51a14.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_cd45bd87e6bab53d5162c25234f134c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_cd45bd87e6bab53d5162c25234f134c9.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_fce577f419fc3214ed3948a1eb6620d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_fce577f419fc3214ed3948a1eb6620d0.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_32824f1e26ce02fa74b854ceec13de31.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_32824f1e26ce02fa74b854ceec13de31.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_43e18a1cef4556e290d0ccb59ed2e290.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_43e18a1cef4556e290d0ccb59ed2e290.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_cc5a46fca9f7ea4629dd3f1a05cc90e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_cc5a46fca9f7ea4629dd3f1a05cc90e2.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_4a64ceba83162b3738897b5c48b25537.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_4a64ceba83162b3738897b5c48b25537.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_e978b43ee2dc204f26a601f3b7f083b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_e978b43ee2dc204f26a601f3b7f083b3.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_9227852b400f00db0bd6125ee87ca3c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_9227852b400f00db0bd6125ee87ca3c9.jpg already downloaded
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F13%252Fef137c46d7f8b9c60dc57961e817a434%252Fpa%252FFX84073_3e115fc6a603b30e4ca4e90acfdd6de8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_3e115fc6a603b30e4ca4e90acfdd6de8.jpg already downloaded
2025-12-05 17:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: af997043-a2fc-5b8b-ae37-429abdcfc376, identifier: FX84073
2025-12-05 17:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf4a903-7508-5e1c-a5aa-a74fb901943d with identifier: JB33063
2025-12-05 17:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf4a903-7508-5e1c-a5aa-a74fb901943d with scrape type 2
2025-12-05 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf4a903-7508-5e1c-a5aa-a74fb901943d with scrape type 2
2025-12-05 17:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0bf4a903-7508-5e1c-a5aa-a74fb901943d, identifier: JB33063
2025-12-05 17:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: af997043-a2fc-5b8b-ae37-429abdcfc376 with identifier: FX84073
2025-12-05 17:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: af997043-a2fc-5b8b-ae37-429abdcfc376 with identifier: FX84073
2025-12-05 17:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: af997043-a2fc-5b8b-ae37-429abdcfc376 with identifier: FX84073 to the API
2025-12-05 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FX84073>
{'auction_title': '',
'c_o_2_emission_value': 53,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 320,
'expiration_date': '2025-12-06T16:50:00Z',
'fuel_type': 'hybrid',
'id': 'af997043-a2fc-5b8b-ae37-429abdcfc376',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX84073',
'listing': 'auction',
'location': 'FR',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 77129,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photo_urls': ['https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_94fd5f15c6c1e94f46737246a69cab85.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_bf56d94f1579496aedc2be90c7fea428.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_960125a5775326f94c2deff246fc548a.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_daea3d9b371108ba4fd485739b11d4c4.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_9b1eb5f38ece415a901da1f0ffe96f16.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_77ac35a59a18a5818f7075bba0d97838.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7625d3eded83fae48301daa23383e8e4.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7bf163a0e03cfbb7666911e4afd8c54c.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7ff0fda179732108a3465a32db5dcec1.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_6c6c56998615626d4f117f939222d5ea.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_874c9a97036d509fcce8d1d18fc51a14.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_cd45bd87e6bab53d5162c25234f134c9.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_fce577f419fc3214ed3948a1eb6620d0.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_32824f1e26ce02fa74b854ceec13de31.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_43e18a1cef4556e290d0ccb59ed2e290.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_cc5a46fca9f7ea4629dd3f1a05cc90e2.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_4a64ceba83162b3738897b5c48b25537.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_e978b43ee2dc204f26a601f3b7f083b3.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_9227852b400f00db0bd6125ee87ca3c9.jpg',
'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_3e115fc6a603b30e4ca4e90acfdd6de8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_94fd5f15c6c1e94f46737246a69cab85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_bf56d94f1579496aedc2be90c7fea428.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_960125a5775326f94c2deff246fc548a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_daea3d9b371108ba4fd485739b11d4c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_9b1eb5f38ece415a901da1f0ffe96f16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_77ac35a59a18a5818f7075bba0d97838.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7625d3eded83fae48301daa23383e8e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7bf163a0e03cfbb7666911e4afd8c54c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_7ff0fda179732108a3465a32db5dcec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_6c6c56998615626d4f117f939222d5ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_874c9a97036d509fcce8d1d18fc51a14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_cd45bd87e6bab53d5162c25234f134c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_fce577f419fc3214ed3948a1eb6620d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_32824f1e26ce02fa74b854ceec13de31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_43e18a1cef4556e290d0ccb59ed2e290.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_cc5a46fca9f7ea4629dd3f1a05cc90e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_4a64ceba83162b3738897b5c48b25537.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_e978b43ee2dc204f26a601f3b7f083b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 15912,
'Height': 320,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_9227852b400f00db0bd6125ee87ca3c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af997043-a2fc-5b8b-ae37-429abdcfc376/af997043-a2fc-5b8b-ae37-429abdcfc376_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18664,
'Height': 267,
'OriginUrl': 'https://img-pa.auto1.com/imgef/13/ef137c46d7f8b9c60dc57961e817a434/pa/FX84073_3e115fc6a603b30e4ca4e90acfdd6de8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic Business',
'transmission': 'automatic',
'trim': '4Matic Business',
'year': 2020}
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX84073%27 HTTP/1.1" 200 None
2025-12-05 17:01:02 [auto1.fr] INFO: Saving data for FX84073: {'created_time': 1764954062.163832, 'last_price_update_time': 1764954062.163843, 'auction_closing_time': 1765039800.0}
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX84073') HTTP/1.1" 204 0
2025-12-05 17:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0bf4a903-7508-5e1c-a5aa-a74fb901943d with identifier: JB33063
2025-12-05 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0bf4a903-7508-5e1c-a5aa-a74fb901943d with identifier: JB33063
2025-12-05 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171838 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171838
2025-12-05 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0bf4a903-7508-5e1c-a5aa-a74fb901943d spider: auto1.fr
2025-12-05 17:01:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0bf4a903-7508-5e1c-a5aa-a74fb901943d due to rule: high_mileage_for_country.json, error: 171838 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171838
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:31:12Z',
'fuel_type': 'diesel',
'id': '0bf4a903-7508-5e1c-a5aa-a74fb901943d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB33063',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 171838,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2020}
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB33063%27 HTTP/1.1" 200 None
2025-12-05 17:01:02 [auto1.fr] INFO: Saving data for JB33063: {'auction_closing_time': 1765038672.0, 'created_time': 1764176786.823898, 'last_price_update_time': 1764954062.419612}
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB33063') HTTP/1.1" 204 0
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8df194c1884c22273fa4bc643eff5a2b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg not downloaded yet
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU04696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK83578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg not downloaded yet
2025-12-05 17:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ca990>
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_1dccf620ecc469149a46530393f00be2.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_1dccf620ecc469149a46530393f00be2.jpg saved to cache
2025-12-05 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5aeaa90>
2025-12-05 17:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F8e%252F068ed53884230e95070d1b059ee41fcf%252Fpa%252FGZ97606_547460aca5105e4a99273a69e71feb1e.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_547460aca5105e4a99273a69e71feb1e.jpg saved to cache
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b90968ce-486a-570a-91e1-cee4dc6336a2
2025-12-05 17:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b90968ce-486a-570a-91e1-cee4dc6336a2, skipping ID generation
2025-12-05 17:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90968ce-486a-570a-91e1-cee4dc6336a2 with scrape type 1
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b90968ce-486a-570a-91e1-cee4dc6336a2 from tracking dictionaries
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b90968ce-486a-570a-91e1-cee4dc6336a2 sending to next pipeline
2025-12-05 17:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b90968ce-486a-570a-91e1-cee4dc6336a2, identifier: GZ97606
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c86d0>
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg saved to cache
2025-12-05 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ac8ad0>
2025-12-05 17:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_d7a6088026e4959e08323f34a68bb357.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg saved to cache
2025-12-05 17:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg not downloaded yet
2025-12-05 17:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b90968ce-486a-570a-91e1-cee4dc6336a2 with identifier: GZ97606
2025-12-05 17:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b90968ce-486a-570a-91e1-cee4dc6336a2 with identifier: GZ97606
2025-12-05 17:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b90968ce-486a-570a-91e1-cee4dc6336a2 with identifier: GZ97606 to the API
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_547460aca5105e4a99273a69e71feb1e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:38:58Z',
'fuel_type': 'electro',
'id': 'b90968ce-486a-570a-91e1-cee4dc6336a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ97606',
'listing': 'auction',
'location': 'FR, Chambray-Lès-Tours',
'make': 'Opel',
'model': 'Corsa',
'odometer': 42259,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2974649,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_1dccf620ecc469149a46530393f00be2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3021665,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_547460aca5105e4a99273a69e71feb1e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2969878,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_66b3dac81650a10c80e2e5bbc9d1ed07.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_c2e936000859b4e77322fbaf724f026f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_89c224a84fae56d7d35e086d442275c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3040565,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_3d53dc8bfdbb2a60ef29963f318b584c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_ba6975cb9f56290be9df70196946e4ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2991349,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5a857d5251c55ad2dcebb27aa1521fa2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_d3a55062785462812e384c23993b791c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2972948,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_b53ce1aad32ea74b0d65ff06d39f4928.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2988993,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f99f92406d9fca1fb65e95af7be543cb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2806591,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_808d950c89d63a30f3dd4bb9baab18e5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_21b90284d4859bf69e001ae3011b03d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2865619,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_5b0f529b04d3fee06216c5988f1ce640.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_f41a6d9328c61c01f5a50e4c2ca51765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90968ce-486a-570a-91e1-cee4dc6336a2/b90968ce-486a-570a-91e1-cee4dc6336a2_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 113908,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img06/8e/068ed53884230e95070d1b059ee41fcf/pa/GZ97606_8eeedc183c317a3f82a937b08e618097.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa electric drive 100 kW Edition Business',
'transmission': 'automatic',
'trim': 'Edition Business',
'year': 2021}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ97606%27 HTTP/1.1" 200 None
2025-12-05 17:01:04 [auto1.fr] INFO: Saving data for GZ97606: {'created_time': 1764954064.510944, 'last_price_update_time': 1764954064.510952, 'auction_closing_time': 1765039138.0}
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ97606') HTTP/1.1" 204 0
2025-12-05 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5918850>
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_081dfca1fb3315e86eb4c3225d633016.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg saved to cache
2025-12-05 17:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5998190>
2025-12-05 17:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_fcee4781da0a19d0118d512db473ec79.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg saved to cache
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5825010>
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg saved to cache
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5988d10>
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8924c01d8baed399e77d84f38df4f5b2.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg saved to cache
2025-12-05 17:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:05 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: EC51536
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC51536%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for EC51536: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: YZ96581
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ96581%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for YZ96581: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: JH13175
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH13175%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for JH13175: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: YE22264
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE22264%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for YE22264: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: FV78924
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV78924%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for FV78924: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: YP04022
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP04022%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for YP04022: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: HB33163
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB33163%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for HB33163: 0
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: KJ75592
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ75592%27 HTTP/1.1" 200 None
2025-12-05 17:01:05 [auto1.fr] INFO: Scrape type for KJ75592: 2
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:05 [auto1.fr] INFO: Found listing with ID: EN26972
2025-12-05 17:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN26972%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for EN26972: 2
2025-12-05 17:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: RD42470
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD42470%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for RD42470: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: LE40598
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE40598%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for LE40598: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: FB75908
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB75908%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for FB75908: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: XK01037
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK01037%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for XK01037: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: PE51974
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE51974%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for PE51974: 2
2025-12-05 17:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: GH40610
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH40610%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for GH40610: 2
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: WY42853
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY42853%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for WY42853: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: JF91147
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF91147%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for JF91147: 2
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: BV08517
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV08517%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for BV08517: 2
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: CF79780
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF79780%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for CF79780: 1
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: FJ05711
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ05711%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for FJ05711: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: WT08030
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT08030%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for WT08030: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: EZ92802
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ92802%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for EZ92802: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: ZC89949
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC89949%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for ZC89949: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: SU01592
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU01592%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for SU01592: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: HF22582
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF22582%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for HF22582: 2
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: DW60912
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW60912%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for DW60912: 0
2025-12-05 17:01:06 [auto1.fr] INFO: Found listing with ID: WP82049
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP82049%27 HTTP/1.1" 200 None
2025-12-05 17:01:06 [auto1.fr] INFO: Scrape type for WP82049: 2
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a09b50>
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_88c027298f6de59497b148ad3e696092.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg saved to cache
2025-12-05 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5fc50>
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg saved to cache
2025-12-05 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f6c50>
2025-12-05 17:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_4aec9d8c825694f77a85824b27d4e795.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg saved to cache
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f6710>
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_8df194c1884c22273fa4bc643eff5a2b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg saved to cache
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ecae10>
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F20%252F0c2097f67a63e2c364bc892b1e17dfb6%252Fpa%252FFF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg saved to cache
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 189a95be-4618-536e-9804-667d96159ec2
2025-12-05 17:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 189a95be-4618-536e-9804-667d96159ec2, skipping ID generation
2025-12-05 17:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189a95be-4618-536e-9804-667d96159ec2 with scrape type 1
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 189a95be-4618-536e-9804-667d96159ec2 from tracking dictionaries
2025-12-05 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 189a95be-4618-536e-9804-667d96159ec2 sending to next pipeline
2025-12-05 17:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 189a95be-4618-536e-9804-667d96159ec2, identifier: FF24140
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: MD49552
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD49552%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for MD49552: 0
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: EM70130
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM70130%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for EM70130: 2
2025-12-05 17:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 189a95be-4618-536e-9804-667d96159ec2 with identifier: FF24140
2025-12-05 17:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 189a95be-4618-536e-9804-667d96159ec2 with identifier: FF24140
2025-12-05 17:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 71577, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ff24140', 'expiration_date': '2025-12-06t16:41:30z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '189a95be-4618-536e-9804-667d96159ec2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 139439}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47011}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55779}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 108312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80413}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75923}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84609}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69810}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 35367}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70224}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg', 'Width': 800, 'Height': 512, 'Extension': 'jpg', 'FileSizeInBytes': 51543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58742}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 27726}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 23576}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 25028}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 21580}], 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 71577}
Failed validating None in schema:
False
On instance:
{'age_in_months': 50,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:41:30z',
'fuel_type': 'petrol',
'id': '189a95be-4618-536e-9804-667d96159ec2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ff24140',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 71577,
'odometer_in_km': 71577,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51543,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27726,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23576,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25028,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21580,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure business',
'transmission': 'automatic',
'trim': 'allure business',
'year': 2021}
2025-12-05 17:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 189a95be-4618-536e-9804-667d96159ec2 spider: auto1.fr
2025-12-05 17:01:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 189a95be-4618-536e-9804-667d96159ec2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 71577, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ff24140', 'expiration_date': '2025-12-06t16:41:30z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '189a95be-4618-536e-9804-667d96159ec2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 139439}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47011}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55779}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 108312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80413}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75923}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84609}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69810}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 35367}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70224}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg', 'Width': 800, 'Height': 512, 'Extension': 'jpg', 'FileSizeInBytes': 51543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58742}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 27726}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 23576}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 25028}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg', 'Width': 800, 'Height': 369, 'Extension': 'jpg', 'FileSizeInBytes': 21580}], 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 71577}
Failed validating None in schema:
False
On instance:
{'age_in_months': 50,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:41:30z',
'fuel_type': 'petrol',
'id': '189a95be-4618-536e-9804-667d96159ec2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ff24140',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 71577,
'odometer_in_km': 71577,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51543,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27726,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23576,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25028,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21580,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure business',
'transmission': 'automatic',
'trim': 'allure business',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:41:30Z',
'fuel_type': 'petrol',
'id': '189a95be-4618-536e-9804-667d96159ec2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF24140',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '2008',
'odometer': 71577,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_f06e41d945066af51ac56ae5c7d97f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_0e6c3cc2de822a4348e6f29ba8448d95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_081dfca1fb3315e86eb4c3225d633016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_fcee4781da0a19d0118d512db473ec79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_cff2330d6411c0a0abf0dafba4ad7909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9f63d38f14e4e5ebf4de248233a30cf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8d6b53a0753451ff081a075290e74fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4603edddd273d9c538f7b0882d83728a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9b0393e0be98578157a64cf9b18b7427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_b960e94713f3696bd20588e4fcf184f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_549bbe3daffc229b4b999bec9642ad53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_d7a6088026e4959e08323f34a68bb357.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8dcce19d5f1ff7d31fc3db5bccfcae97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8924c01d8baed399e77d84f38df4f5b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51543,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8e3eb9a3b381a788acd3affb42e1899b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_4aec9d8c825694f77a85824b27d4e795.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27726,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_88c027298f6de59497b148ad3e696092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23576,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_8df194c1884c22273fa4bc643eff5a2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25028,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_9c780ff3f2c0fc6a81c3d923c4974fda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189a95be-4618-536e-9804-667d96159ec2/189a95be-4618-536e-9804-667d96159ec2_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21580,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img0c/20/0c2097f67a63e2c364bc892b1e17dfb6/pa/FF24140_bfeb2d38d3ee0f2e4b0943c8958657cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2021}
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF24140%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Saving data for FF24140: {'created_time': 1764954068.367899, 'last_price_update_time': 1764954068.367908, 'auction_closing_time': 1765039290.0}
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FF24140') HTTP/1.1" 204 0
2025-12-05 17:01:08 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 119 pages/min), scraped 31 items (at 31 items/min)
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU04696> (referer: https://www.auto1.com/v1/car-details-view/RU04696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK83578> (referer: https://www.auto1.com/v1/car-details-view/NK83578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ75592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: VP48063
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP48063%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for VP48063: 2
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX55378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB59403> (referer: https://www.auto1.com/v1/car-details-view/SB59403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM92526> (referer: https://www.auto1.com/v1/car-details-view/SM92526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL32967> (referer: https://www.auto1.com/v1/car-details-view/NL32967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: GS53856
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS53856%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for GS53856: 0
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: HV76455
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV76455%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for HV76455: 0
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: PA14498
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA14498%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for PA14498: 2
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: LM10259
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM10259%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for LM10259: 2
2025-12-05 17:01:08 [auto1.fr] INFO: Found listing with ID: HB62357
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB62357%27 HTTP/1.1" 200 None
2025-12-05 17:01:08 [auto1.fr] INFO: Scrape type for HB62357: 2
2025-12-05 17:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec16c1a4-b8f2-550e-aa47-27946067605b with identifier: RU04696
2025-12-05 17:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec16c1a4-b8f2-550e-aa47-27946067605b with scrape type 2
2025-12-05 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec16c1a4-b8f2-550e-aa47-27946067605b with scrape type 2
2025-12-05 17:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec16c1a4-b8f2-550e-aa47-27946067605b, identifier: RU04696
2025-12-05 17:01:08 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d with identifier: NK83578
2025-12-05 17:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d with scrape type 2
2025-12-05 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d with scrape type 2
2025-12-05 17:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d, identifier: NK83578
2025-12-05 17:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2e4fda-01b6-52df-b2c8-ab468d37116e with identifier: SB59403
2025-12-05 17:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2e4fda-01b6-52df-b2c8-ab468d37116e with scrape type 2
2025-12-05 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c2e4fda-01b6-52df-b2c8-ab468d37116e with scrape type 2
2025-12-05 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2c2e4fda-01b6-52df-b2c8-ab468d37116e, identifier: SB59403
2025-12-05 17:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc with identifier: SM92526
2025-12-05 17:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc with scrape type 2
2025-12-05 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc with scrape type 2
2025-12-05 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc, identifier: SM92526
2025-12-05 17:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa with identifier: NL32967
2025-12-05 17:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa with scrape type 2
2025-12-05 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa with scrape type 2
2025-12-05 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa, identifier: NL32967
2025-12-05 17:01:09 [auto1.fr] INFO: Found listing with ID: EW63737
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW63737%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Scrape type for EW63737: 0
2025-12-05 17:01:09 [auto1.fr] INFO: Found listing with ID: AE25623
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE25623%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Scrape type for AE25623: 0
2025-12-05 17:01:09 [auto1.fr] INFO: Found listing with ID: MP62550
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP62550%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Scrape type for MP62550: 0
2025-12-05 17:01:09 [auto1.fr] INFO: Found listing with ID: WD02097
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD02097%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Scrape type for WD02097: 0
2025-12-05 17:01:09 [auto1.fr] INFO: Found listing with ID: PW64161
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW64161%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Scrape type for PW64161: 0
2025-12-05 17:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec16c1a4-b8f2-550e-aa47-27946067605b with identifier: RU04696
2025-12-05 17:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec16c1a4-b8f2-550e-aa47-27946067605b with identifier: RU04696
2025-12-05 17:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156385 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
156385
2025-12-05 17:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec16c1a4-b8f2-550e-aa47-27946067605b spider: auto1.fr
2025-12-05 17:01:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ec16c1a4-b8f2-550e-aa47-27946067605b due to rule: high_mileage_for_country.json, error: 156385 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
156385
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:46:10Z',
'fuel_type': 'petrol',
'id': 'ec16c1a4-b8f2-550e-aa47-27946067605b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU04696',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Seat',
'model': 'Ateca',
'odometer': 156385,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2017}
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU04696%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Saving data for RU04696: {'auction_closing_time': 1765039570.0, 'created_time': 1764842622.315686, 'last_price_update_time': 1764954069.493277}
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU04696') HTTP/1.1" 204 0
2025-12-05 17:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d with identifier: NK83578
2025-12-05 17:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d with identifier: NK83578
2025-12-05 17:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e0ab622-9d9d-516d-a1a9-feb4fb730b0d with identifier: NK83578 to the API
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK83578>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:55:21Z',
'fuel_type': 'diesel',
'id': '4e0ab622-9d9d-516d-a1a9-feb4fb730b0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK83578',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 84068,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-15',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Creative 4WD',
'transmission': 'automatic',
'trim': 'Creative 4WD',
'year': 2019}
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK83578%27 HTTP/1.1" 200 None
2025-12-05 17:01:09 [auto1.fr] INFO: Saving data for NK83578: {'auction_closing_time': 1765040121.0, 'created_time': 1762277698.100312, 'last_price_update_time': 1764954069.988345}
2025-12-05 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK83578') HTTP/1.1" 204 0
2025-12-05 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2c2e4fda-01b6-52df-b2c8-ab468d37116e with identifier: SB59403
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2c2e4fda-01b6-52df-b2c8-ab468d37116e with identifier: SB59403
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 88188, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb59403', 'expiration_date': '2025-12-06t16:28:04z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 150, 'id': '2c2e4fda-01b6-52df-b2c8-ab468d37116e', 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 88188}
Failed validating None in schema:
False
On instance:
{'age_in_months': 65,
'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:28:04z',
'fuel_type': 'petrol',
'id': '2c2e4fda-01b6-52df-b2c8-ab468d37116e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb59403',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 88188,
'odometer_in_km': 88188,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-02',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2020}
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2c2e4fda-01b6-52df-b2c8-ab468d37116e spider: auto1.fr
2025-12-05 17:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2c2e4fda-01b6-52df-b2c8-ab468d37116e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 88188, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb59403', 'expiration_date': '2025-12-06t16:28:04z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 150, 'id': '2c2e4fda-01b6-52df-b2c8-ab468d37116e', 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 88188}
Failed validating None in schema:
False
On instance:
{'age_in_months': 65,
'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:28:04z',
'fuel_type': 'petrol',
'id': '2c2e4fda-01b6-52df-b2c8-ab468d37116e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb59403',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 88188,
'odometer_in_km': 88188,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-02',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:28:04Z',
'fuel_type': 'petrol',
'id': '2c2e4fda-01b6-52df-b2c8-ab468d37116e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB59403',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 88188,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2020}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB59403%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Saving data for SB59403: {'auction_closing_time': 1765038484.0, 'created_time': 1764151359.273811, 'last_price_update_time': 1764954070.232656}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SB59403') HTTP/1.1" 204 0
2025-12-05 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc with identifier: SM92526
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc with identifier: SM92526
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154692 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154692
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc spider: auto1.fr
2025-12-05 17:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1f07fa6e-4ab0-592d-aa40-a5c35a7886bc due to rule: high_mileage_for_country.json, error: 154692 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154692
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:18:12Z',
'fuel_type': 'diesel',
'id': '1f07fa6e-4ab0-592d-aa40-a5c35a7886bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM92526',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 154692,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-28',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM92526%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Saving data for SM92526: {'auction_closing_time': 1765037892.0, 'created_time': 1764842760.731193, 'last_price_update_time': 1764954070.460338}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM92526') HTTP/1.1" 204 0
2025-12-05 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa with identifier: NL32967
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2025-12-05 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa with identifier: NL32967
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa spider: auto1.fr
2025-12-05 17:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2025-12-06T16:29:27Z',
'fuel_type': 'diesel',
'id': 'fc8fbb84-a0b3-5681-85f9-dcb613d6c9aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL32967',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 179424,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi XTR',
'transmission': 'manual',
'trim': 'XTR',
'year': 2016}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL32967%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Saving data for NL32967: {'auction_closing_time': 1765038567.0, 'created_time': 1764435948.402105, 'last_price_update_time': 1764954070.840429}
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL32967') HTTP/1.1" 204 0
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: PW64161
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW64161%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for PW64161: 0
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: ST01655
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST01655%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for ST01655: 2
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: YJ20644
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ20644%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for YJ20644: 0
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: PB37272
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB37272%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for PB37272: 0
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: TS14045
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS14045%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for TS14045: 2
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: VG68439
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG68439%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for VG68439: 2
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: AE94219
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE94219%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for AE94219: 0
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: JW96531
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW96531%27 HTTP/1.1" 200 None
2025-12-05 17:01:10 [auto1.fr] INFO: Scrape type for JW96531: 2
2025-12-05 17:01:10 [auto1.fr] INFO: Found listing with ID: FS72144
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS72144%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for FS72144: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: DC26621
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC26621%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for DC26621: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: VL77916
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL77916%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for VL77916: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: SS73684
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS73684%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for SS73684: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: AR27100
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR27100%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for AR27100: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: VS51600
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS51600%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for VS51600: 2
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: JJ21098
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ21098%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for JJ21098: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: WV26498
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV26498%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for WV26498: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: AV64763
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV64763%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for AV64763: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: RW22448
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW22448%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for RW22448: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: TZ36595
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ36595%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for TZ36595: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: UG19647
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG19647%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for UG19647: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: US26659
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US26659%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for US26659: 2
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: MG08518
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG08518%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for MG08518: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: RH01127
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH01127%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for RH01127: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: ZD09724
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD09724%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for ZD09724: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: KJ48240
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ48240%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for KJ48240: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: KV02973
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV02973%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for KV02973: 2
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: MS97177
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS97177%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for MS97177: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: VW11440
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW11440%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for VW11440: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: UJ87770
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ87770%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for UJ87770: 2
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: SZ93950
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ93950%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for SZ93950: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: EK80297
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK80297%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for EK80297: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: ZV14610
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV14610%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for ZV14610: 2
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: UW32119
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW32119%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for UW32119: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: DN71115
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN71115%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for DN71115: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: MS95017
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS95017%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for MS95017: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: TY11370
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY11370%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for TY11370: 2
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: EC55265
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC55265%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for EC55265: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: VS58837
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS58837%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for VS58837: 0
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: UE09620
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE09620%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for UE09620: 1
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN26972/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [auto1.fr] INFO: Found listing with ID: VV81985
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV81985%27 HTTP/1.1" 200 None
2025-12-05 17:01:11 [auto1.fr] INFO: Scrape type for VV81985: 1
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH40610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE51974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV08517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP82049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF91147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM10259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX55378> (referer: https://www.auto1.com/v1/car-details-view/MX55378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM70130/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA14498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065f7fa8-b656-535e-8290-d7d7795dde44 with identifier: MX55378
2025-12-05 17:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065f7fa8-b656-535e-8290-d7d7795dde44 with scrape type 2
2025-12-05 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065f7fa8-b656-535e-8290-d7d7795dde44 with scrape type 2
2025-12-05 17:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 065f7fa8-b656-535e-8290-d7d7795dde44, identifier: MX55378
2025-12-05 17:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 065f7fa8-b656-535e-8290-d7d7795dde44 with identifier: MX55378
2025-12-05 17:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 065f7fa8-b656-535e-8290-d7d7795dde44 with identifier: MX55378
2025-12-05 17:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 065f7fa8-b656-535e-8290-d7d7795dde44 with identifier: MX55378 to the API
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX55378>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:47:57Z',
'fuel_type': 'diesel',
'id': '065f7fa8-b656-535e-8290-d7d7795dde44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX55378',
'listing': 'auction',
'location': 'FR, Anais',
'make': 'Renault',
'model': 'Scenic',
'odometer': 126853,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2017}
2025-12-05 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX55378%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Saving data for MX55378: {'auction_closing_time': 1765039677.0, 'created_time': 1764262924.218203, 'last_price_update_time': 1764954073.003202}
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MX55378') HTTP/1.1" 204 0
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ75592> (referer: https://www.auto1.com/v1/car-details-view/KJ75592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF79780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF22582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c3531a-707d-5315-ae76-4a4fa91a9f7c with identifier: KJ75592
2025-12-05 17:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c3531a-707d-5315-ae76-4a4fa91a9f7c with scrape type 2
2025-12-05 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c3531a-707d-5315-ae76-4a4fa91a9f7c with scrape type 2
2025-12-05 17:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74c3531a-707d-5315-ae76-4a4fa91a9f7c, identifier: KJ75592
2025-12-05 17:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74c3531a-707d-5315-ae76-4a4fa91a9f7c with identifier: KJ75592
2025-12-05 17:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74c3531a-707d-5315-ae76-4a4fa91a9f7c with identifier: KJ75592
2025-12-05 17:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 59321, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kj75592', 'expiration_date': '2025-12-06t16:07:13z', 'origin_country_code': 'fr', 'trim': 'chic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '74c3531a-707d-5315-ae76-4a4fa91a9f7c', 'current_year_diff': 6, 'age_in_months': 76, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 59321}
Failed validating None in schema:
False
On instance:
{'age_in_months': 76,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:07:13z',
'fuel_type': 'petrol',
'id': '74c3531a-707d-5315-ae76-4a4fa91a9f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kj75592',
'listing': 'auction',
'location': 'fr, villenoy',
'make': 'ds automobiles',
'make_model': 'ds automobiles ds3 crossback',
'model': 'ds3 crossback',
'odometer': 59321,
'odometer_in_km': 59321,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-17',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds3 crossback 1.2 puretech chic',
'transmission': 'automatic',
'trim': 'chic',
'year': 2019}
2025-12-05 17:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 74c3531a-707d-5315-ae76-4a4fa91a9f7c spider: auto1.fr
2025-12-05 17:01:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 74c3531a-707d-5315-ae76-4a4fa91a9f7c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 59321, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kj75592', 'expiration_date': '2025-12-06t16:07:13z', 'origin_country_code': 'fr', 'trim': 'chic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '74c3531a-707d-5315-ae76-4a4fa91a9f7c', 'current_year_diff': 6, 'age_in_months': 76, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 59321}
Failed validating None in schema:
False
On instance:
{'age_in_months': 76,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:07:13z',
'fuel_type': 'petrol',
'id': '74c3531a-707d-5315-ae76-4a4fa91a9f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kj75592',
'listing': 'auction',
'location': 'fr, villenoy',
'make': 'ds automobiles',
'make_model': 'ds automobiles ds3 crossback',
'model': 'ds3 crossback',
'odometer': 59321,
'odometer_in_km': 59321,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-17',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds3 crossback 1.2 puretech chic',
'transmission': 'automatic',
'trim': 'chic',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:07:13Z',
'fuel_type': 'petrol',
'id': '74c3531a-707d-5315-ae76-4a4fa91a9f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ75592',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'DS Automobiles',
'model': 'DS3 Crossback',
'odometer': 59321,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-17',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Chic',
'transmission': 'automatic',
'trim': 'Chic',
'year': 2019}
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ75592%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Saving data for KJ75592: {'auction_closing_time': 1765037233.0, 'created_time': 1764756136.906954, 'last_price_update_time': 1764954073.554195}
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KJ75592') HTTP/1.1" 204 0
2025-12-05 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:13 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: GG29821
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG29821%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for GG29821: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: YP90281
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP90281%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for YP90281: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: VE14391
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE14391%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for VE14391: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: ZC58388
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC58388%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for ZC58388: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: SE92731
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE92731%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for SE92731: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: VM91260
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM91260%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for VM91260: 2
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: CB65881
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB65881%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for CB65881: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: TY97687
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY97687%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for TY97687: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: NY55056
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY55056%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for NY55056: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: RY09036
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY09036%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for RY09036: 2
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: GE92287
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE92287%27 HTTP/1.1" 200 None
2025-12-05 17:01:13 [auto1.fr] INFO: Scrape type for GE92287: 0
2025-12-05 17:01:13 [auto1.fr] INFO: Found listing with ID: WX09480
2025-12-05 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX09480%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for WX09480: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: EW78786
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW78786%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for EW78786: 2
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: HH77489
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH77489%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for HH77489: 2
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: YJ42638
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ42638%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for YJ42638: 2
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: DS57925
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS57925%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for DS57925: 2
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: LR17067
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR17067%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for LR17067: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: KJ42673
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ42673%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for KJ42673: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: HC91414
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC91414%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for HC91414: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: AM99512
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM99512%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for AM99512: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: ZF52648
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF52648%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for ZF52648: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: AT92921
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT92921%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for AT92921: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: VG06254
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG06254%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for VG06254: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: KN40934
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN40934%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for KN40934: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: WN92685
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN92685%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for WN92685: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: GE18149
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE18149%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for GE18149: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: AN42455
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN42455%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for AN42455: 2
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE09620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: CM75358
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM75358%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for CM75358: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: PX85302
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX85302%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for PX85302: 2
2025-12-05 17:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV81985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB62357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: VV60694
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV60694%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for VV60694: 2
2025-12-05 17:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: ZB24070
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB24070%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for ZB24070: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: NN20661
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN20661%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for NN20661: 2
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: ET74114
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET74114%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for ET74114: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: LH63858
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH63858%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for LH63858: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: HC92649
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC92649%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for HC92649: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: WJ49569
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ49569%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for WJ49569: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: XA69417
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA69417%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for XA69417: 2
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV14610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: EU24889
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU24889%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for EU24889: 2
2025-12-05 17:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN26972> (referer: https://www.auto1.com/v1/car-details-view/EN26972/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: XA65638
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA65638%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for XA65638: 0
2025-12-05 17:01:14 [auto1.fr] INFO: Found listing with ID: FS90726
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS90726%27 HTTP/1.1" 200 None
2025-12-05 17:01:14 [auto1.fr] INFO: Scrape type for FS90726: 0
2025-12-05 17:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d06c08-8bf9-5758-8578-46421ca41156 with identifier: EN26972
2025-12-05 17:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d06c08-8bf9-5758-8578-46421ca41156 with scrape type 2
2025-12-05 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2d06c08-8bf9-5758-8578-46421ca41156 with scrape type 2
2025-12-05 17:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2d06c08-8bf9-5758-8578-46421ca41156, identifier: EN26972
2025-12-05 17:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2d06c08-8bf9-5758-8578-46421ca41156 with identifier: EN26972
2025-12-05 17:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2d06c08-8bf9-5758-8578-46421ca41156 with identifier: EN26972
2025-12-05 17:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2d06c08-8bf9-5758-8578-46421ca41156 with identifier: EN26972 to the API
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN26972>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:18:47Z',
'fuel_type': 'hybrid',
'id': 'e2d06c08-8bf9-5758-8578-46421ca41156',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN26972',
'listing': 'auction',
'location': 'FR, Montigny-le-Bretonneux',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 54403,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2021}
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN26972%27 HTTP/1.1" 200 None
2025-12-05 17:01:15 [auto1.fr] INFO: Saving data for EN26972: {'auction_closing_time': 1765037927.0, 'created_time': 1764867645.047956, 'last_price_update_time': 1764954075.010527}
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EN26972') HTTP/1.1" 204 0
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ87770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY11370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF91147> (referer: https://www.auto1.com/v1/car-details-view/JF91147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM10259> (referer: https://www.auto1.com/v1/car-details-view/LM10259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV08517> (referer: https://www.auto1.com/v1/car-details-view/BV08517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE51974> (referer: https://www.auto1.com/v1/car-details-view/PE51974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c with identifier: JF91147
2025-12-05 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c, identifier: JF91147
2025-12-05 17:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c with identifier: JF91147
2025-12-05 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c with identifier: JF91147
2025-12-05 17:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c with identifier: JF91147 to the API
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF91147>
{'auction_title': '',
'c_o_2_emission_value': 59,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.9L',
'engine_horse_power': 462,
'expiration_date': '2025-12-06T16:34:26Z',
'fuel_type': 'hybrid',
'id': '4f612ac7-ac30-5621-ad7c-ef8c8b7fa02c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF91147',
'listing': 'auction',
'location': 'FR, Boulogne-Billancourt',
'make': 'Porsche',
'model': 'Panamera Sport Turismo',
'odometer': 114960,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Panamera Sport Turismo 4 E-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF91147%27 HTTP/1.1" 200 None
2025-12-05 17:01:16 [auto1.fr] INFO: Saving data for JF91147: {'auction_closing_time': 1765038866.0, 'created_time': 1764842539.920976, 'last_price_update_time': 1764954076.481569}
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JF91147') HTTP/1.1" 204 0
2025-12-05 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV02973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP48063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60af4b7e-98c1-59c8-851d-ccedfc91ce10 with identifier: LM10259
2025-12-05 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60af4b7e-98c1-59c8-851d-ccedfc91ce10 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60af4b7e-98c1-59c8-851d-ccedfc91ce10 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60af4b7e-98c1-59c8-851d-ccedfc91ce10, identifier: LM10259
2025-12-05 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7772d49b-3e47-5e57-85af-03e3298d99d2 with identifier: BV08517
2025-12-05 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7772d49b-3e47-5e57-85af-03e3298d99d2 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7772d49b-3e47-5e57-85af-03e3298d99d2 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7772d49b-3e47-5e57-85af-03e3298d99d2, identifier: BV08517
2025-12-05 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490712d7-2acc-5941-8731-a51c25bec810 with identifier: PE51974
2025-12-05 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490712d7-2acc-5941-8731-a51c25bec810 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490712d7-2acc-5941-8731-a51c25bec810 with scrape type 2
2025-12-05 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 490712d7-2acc-5941-8731-a51c25bec810, identifier: PE51974
2025-12-05 17:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60af4b7e-98c1-59c8-851d-ccedfc91ce10 with identifier: LM10259
2025-12-05 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60af4b7e-98c1-59c8-851d-ccedfc91ce10 with identifier: LM10259
2025-12-05 17:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60af4b7e-98c1-59c8-851d-ccedfc91ce10 with identifier: LM10259 to the API
2025-12-05 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LM10259>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 160,
'expiration_date': '2025-12-06T16:53:41Z',
'fuel_type': 'diesel',
'id': '60af4b7e-98c1-59c8-851d-ccedfc91ce10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10259',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 120271,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM10259%27 HTTP/1.1" 200 None
2025-12-05 17:01:17 [auto1.fr] INFO: Saving data for LM10259: {'auction_closing_time': 1765040021.0, 'created_time': 1764090587.998434, 'last_price_update_time': 1764954077.181467}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LM10259') HTTP/1.1" 204 0
2025-12-05 17:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7772d49b-3e47-5e57-85af-03e3298d99d2 with identifier: BV08517
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7772d49b-3e47-5e57-85af-03e3298d99d2 with identifier: BV08517
2025-12-05 17:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7772d49b-3e47-5e57-85af-03e3298d99d2 with identifier: BV08517 to the API
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV08517>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:23:19Z',
'fuel_type': 'petrol',
'id': '7772d49b-3e47-5e57-85af-03e3298d99d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV08517',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 78975,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2019}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV08517%27 HTTP/1.1" 200 None
2025-12-05 17:01:17 [auto1.fr] INFO: Saving data for BV08517: {'auction_closing_time': 1765038199.0, 'created_time': 1762277741.893595, 'last_price_update_time': 1764954077.611017}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BV08517') HTTP/1.1" 204 0
2025-12-05 17:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 490712d7-2acc-5941-8731-a51c25bec810 with identifier: PE51974
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 490712d7-2acc-5941-8731-a51c25bec810 with identifier: PE51974
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167626 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167626
2025-12-05 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 490712d7-2acc-5941-8731-a51c25bec810 spider: auto1.fr
2025-12-05 17:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 490712d7-2acc-5941-8731-a51c25bec810 due to rule: high_mileage_for_country.json, error: 167626 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167626
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': 'Taxi',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2025-12-06T16:20:39Z',
'fuel_type': 'diesel',
'id': '490712d7-2acc-5941-8731-a51c25bec810',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE51974',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Volvo',
'model': 'XC60',
'odometer': 167626,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Business Executive 2WD',
'transmission': 'automatic',
'trim': 'Business Executive 2WD',
'year': 2022}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE51974%27 HTTP/1.1" 200 None
2025-12-05 17:01:17 [auto1.fr] INFO: Saving data for PE51974: {'auction_closing_time': 1765038039.0, 'created_time': 1764842636.165301, 'last_price_update_time': 1764954077.869226}
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE51974') HTTP/1.1" 204 0
2025-12-05 17:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH40610> (referer: https://www.auto1.com/v1/car-details-view/GH40610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP82049> (referer: https://www.auto1.com/v1/car-details-view/WP82049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120ff6fe-44d6-5969-8809-c7c2cd857c0b with identifier: GH40610
2025-12-05 17:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120ff6fe-44d6-5969-8809-c7c2cd857c0b with scrape type 2
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 120ff6fe-44d6-5969-8809-c7c2cd857c0b with scrape type 2
2025-12-05 17:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 120ff6fe-44d6-5969-8809-c7c2cd857c0b, identifier: GH40610
2025-12-05 17:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 120ff6fe-44d6-5969-8809-c7c2cd857c0b with identifier: GH40610
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 120ff6fe-44d6-5969-8809-c7c2cd857c0b with identifier: GH40610
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 132995, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gh40610', 'expiration_date': '2025-12-06t16:50:33z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'caluire et cuire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '120ff6fe-44d6-5969-8809-c7c2cd857c0b', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 132995}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:50:33z',
'fuel_type': 'petrol',
'id': '120ff6fe-44d6-5969-8809-c7c2cd857c0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gh40610',
'listing': 'auction',
'location': 'caluire et cuire',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 132995,
'odometer_in_km': 132995,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-24',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech graphic',
'transmission': 'manual',
'trim': 'graphic',
'year': 2019}
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 120ff6fe-44d6-5969-8809-c7c2cd857c0b spider: auto1.fr
2025-12-05 17:01:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 120ff6fe-44d6-5969-8809-c7c2cd857c0b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 132995, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gh40610', 'expiration_date': '2025-12-06t16:50:33z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'caluire et cuire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '120ff6fe-44d6-5969-8809-c7c2cd857c0b', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 132995}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:50:33z',
'fuel_type': 'petrol',
'id': '120ff6fe-44d6-5969-8809-c7c2cd857c0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gh40610',
'listing': 'auction',
'location': 'caluire et cuire',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 132995,
'odometer_in_km': 132995,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-24',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech graphic',
'transmission': 'manual',
'trim': 'graphic',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:50:33Z',
'fuel_type': 'petrol',
'id': '120ff6fe-44d6-5969-8809-c7c2cd857c0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH40610',
'listing': 'auction',
'location': 'Caluire et Cuire',
'make': 'Citroen',
'model': 'C3',
'odometer': 132995,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-24',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Graphic',
'transmission': 'manual',
'trim': 'Graphic',
'year': 2019}
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH40610%27 HTTP/1.1" 200 None
2025-12-05 17:01:18 [auto1.fr] INFO: Saving data for GH40610: {'auction_closing_time': 1765039833.0, 'created_time': 1764756194.58818, 'last_price_update_time': 1764954078.358772}
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GH40610') HTTP/1.1" 204 0
2025-12-05 17:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b519d2be-1ac2-5d56-a93d-f40247791b65 with identifier: WP82049
2025-12-05 17:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b519d2be-1ac2-5d56-a93d-f40247791b65 with scrape type 2
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b519d2be-1ac2-5d56-a93d-f40247791b65 with scrape type 2
2025-12-05 17:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b519d2be-1ac2-5d56-a93d-f40247791b65, identifier: WP82049
2025-12-05 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS57925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b519d2be-1ac2-5d56-a93d-f40247791b65 with identifier: WP82049
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b519d2be-1ac2-5d56-a93d-f40247791b65 with identifier: WP82049
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141286 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
141286
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: b519d2be-1ac2-5d56-a93d-f40247791b65 spider: auto1.fr
2025-12-05 17:01:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b519d2be-1ac2-5d56-a93d-f40247791b65 due to rule: high_mileage_for_make.json, error: 141286 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
141286
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:40:58Z',
'fuel_type': 'diesel',
'id': 'b519d2be-1ac2-5d56-a93d-f40247791b65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP82049',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 141286,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-02',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
'transmission': 'automatic',
'trim': 'SE Dynamic',
'year': 2018}
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP82049%27 HTTP/1.1" 200 None
2025-12-05 17:01:18 [auto1.fr] INFO: Saving data for WP82049: {'auction_closing_time': 1765039258.0, 'created_time': 1764842685.215881, 'last_price_update_time': 1764954078.709378}
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WP82049') HTTP/1.1" 204 0
2025-12-05 17:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX85302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN42455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF22582> (referer: https://www.auto1.com/v1/car-details-view/HF22582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 with identifier: HF22582
2025-12-05 17:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 with scrape type 2
2025-12-05 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 with scrape type 2
2025-12-05 17:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966, identifier: HF22582
2025-12-05 17:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 with identifier: HF22582
2025-12-05 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 with identifier: HF22582
2025-12-05 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 x 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 x', 'transmission': 'automatic', 'odometer': 5532, 'odometer_reading_unit': 'km', 'registration_date': '2023-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hf22582', 'expiration_date': '2025-12-06t16:08:59z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '4ab7ec54-3ccf-5a06-a4e2-bb61356ac966', 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'citroen c4 x', 'sanitized_make': 'citroen', 'odometer_in_km': 5532}
Failed validating None in schema:
False
On instance:
{'age_in_months': 24,
'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 4,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:08:59z',
'fuel_type': 'petrol',
'id': '4ab7ec54-3ccf-5a06-a4e2-bb61356ac966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hf22582',
'listing': 'auction',
'location': 'fr, houecourt',
'make': 'citroen',
'make_model': 'citroen c4 x',
'model': 'c4 x',
'odometer': 5532,
'odometer_in_km': 5532,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 x 1.2 puretech feel pack',
'transmission': 'automatic',
'trim': 'feel pack',
'year': 2023}
2025-12-05 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 spider: auto1.fr
2025-12-05 17:01:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4ab7ec54-3ccf-5a06-a4e2-bb61356ac966 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 x 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 x', 'transmission': 'automatic', 'odometer': 5532, 'odometer_reading_unit': 'km', 'registration_date': '2023-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hf22582', 'expiration_date': '2025-12-06t16:08:59z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '4ab7ec54-3ccf-5a06-a4e2-bb61356ac966', 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'citroen c4 x', 'sanitized_make': 'citroen', 'odometer_in_km': 5532}
Failed validating None in schema:
False
On instance:
{'age_in_months': 24,
'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 4,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:08:59z',
'fuel_type': 'petrol',
'id': '4ab7ec54-3ccf-5a06-a4e2-bb61356ac966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hf22582',
'listing': 'auction',
'location': 'fr, houecourt',
'make': 'citroen',
'make_model': 'citroen c4 x',
'model': 'c4 x',
'odometer': 5532,
'odometer_in_km': 5532,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 x 1.2 puretech feel pack',
'transmission': 'automatic',
'trim': 'feel pack',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:08:59Z',
'fuel_type': 'petrol',
'id': '4ab7ec54-3ccf-5a06-a4e2-bb61356ac966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF22582',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Citroen',
'model': 'C4 X',
'odometer': 5532,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 X 1.2 PureTech Feel Pack',
'transmission': 'automatic',
'trim': 'Feel Pack',
'year': 2023}
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF22582%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [auto1.fr] INFO: Saving data for HF22582: {'auction_closing_time': 1765037339.0, 'created_time': 1764842754.634299, 'last_price_update_time': 1764954079.15065}
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HF22582') HTTP/1.1" 204 0
2025-12-05 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE09620> (referer: https://www.auto1.com/v1/car-details-view/UE09620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70642db3-3977-5909-a253-c5e72806df0b with identifier: UE09620
2025-12-05 17:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70642db3-3977-5909-a253-c5e72806df0b with scrape type 1
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_0a207a2ee80c52525549486adb2d4958.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0a207a2ee80c52525549486adb2d4958.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_f57e6471e2009160ec995233f4fdd648.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f57e6471e2009160ec995233f4fdd648.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_1264ac590b960b09363d4a8713bfe45c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_1264ac590b960b09363d4a8713bfe45c.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_588ae49391e8a75734117b7009a7ab29.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_588ae49391e8a75734117b7009a7ab29.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_8f89f4d0e9d6ee9dc946901688057dde.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_8f89f4d0e9d6ee9dc946901688057dde.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_0c3c1dd4a54814a10245476598a29be7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0c3c1dd4a54814a10245476598a29be7.jpg not downloaded yet
2025-12-05 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV81985> (referer: https://www.auto1.com/v1/car-details-view/VV81985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_7d5ca5a4fc0ea3ea072d44c1bf9e5326.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_7d5ca5a4fc0ea3ea072d44c1bf9e5326.jpg not downloaded yet
2025-12-05 17:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_0ec8d9ea75966e38493694c33f521a35.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0ec8d9ea75966e38493694c33f521a35.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_6100ea5b8a246678c4c486fc508c06c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_6100ea5b8a246678c4c486fc508c06c0.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_d5e527010f4c3d65d034efd276e6c6ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_d5e527010f4c3d65d034efd276e6c6ed.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_afac44909a1975abe537a7e11e345563.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_afac44909a1975abe537a7e11e345563.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_02c1c26124614cb15f20e37aaa279dd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_02c1c26124614cb15f20e37aaa279dd2.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_14597d875c61ce93d8c116b7f6b0359b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_14597d875c61ce93d8c116b7f6b0359b.jpg not downloaded yet
2025-12-05 17:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf with identifier: VV81985
2025-12-05 17:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf with scrape type 1
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_94c9aa796628097a133711c95850938b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_c61f7be805a9341eca2e5e9476af7c21.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_c61f7be805a9341eca2e5e9476af7c21.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_f11c9e28b2b05a1b55060ca7f81e4565.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f11c9e28b2b05a1b55060ca7f81e4565.png not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_146c8bd874642d3cf7a6c240f13152b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_f3665556ddeca0f740354bcc26362932.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg not downloaded yet
2025-12-05 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0c3c1dd4a54814a10245476598a29be7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_fbc198f5e5fb38441be82a873382b272.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_78bdeff759ef30058c23d83af94188ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_78d334f6dab7e3a7f9452818c8261b02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg not downloaded yet
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_3959ef8184a04ebf155ad9c7594313f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg not downloaded yet
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c586f050>
2025-12-05 17:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_0c3c1dd4a54814a10245476598a29be7.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0c3c1dd4a54814a10245476598a29be7.jpg saved to cache
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_40037c26df52a4608d0222301fb726a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg not downloaded yet
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA69417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg not downloaded yet
2025-12-05 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU24889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY11370> (referer: https://www.auto1.com/v1/car-details-view/TY11370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ87770> (referer: https://www.auto1.com/v1/car-details-view/UJ87770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_d06d7edbd9a0151b42557992ba64a6db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg not downloaded yet
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_bf64a79d9759b71e819a97e6a3243107.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg not downloaded yet
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e1d10>
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_f3665556ddeca0f740354bcc26362932.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg saved to cache
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV60694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275799b3-d570-5db8-85e2-25cf9f9a7f60 with identifier: TY11370
2025-12-05 17:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275799b3-d570-5db8-85e2-25cf9f9a7f60 with scrape type 2
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275799b3-d570-5db8-85e2-25cf9f9a7f60 with scrape type 2
2025-12-05 17:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 275799b3-d570-5db8-85e2-25cf9f9a7f60, identifier: TY11370
2025-12-05 17:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd with identifier: UJ87770
2025-12-05 17:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd with scrape type 2
2025-12-05 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd with scrape type 2
2025-12-05 17:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd, identifier: UJ87770
2025-12-05 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 275799b3-d570-5db8-85e2-25cf9f9a7f60 with identifier: TY11370
2025-12-05 17:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 275799b3-d570-5db8-85e2-25cf9f9a7f60 with identifier: TY11370
2025-12-05 17:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 111603, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty11370', 'expiration_date': '2025-12-06t16:08:33z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '275799b3-d570-5db8-85e2-25cf9f9a7f60', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 111603}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:08:33z',
'fuel_type': 'petrol',
'id': '275799b3-d570-5db8-85e2-25cf9f9a7f60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty11370',
'listing': 'auction',
'location': 'fr, saint-saulve',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 111603,
'odometer_in_km': 111603,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-18',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2017}
2025-12-05 17:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 275799b3-d570-5db8-85e2-25cf9f9a7f60 spider: auto1.fr
2025-12-05 17:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 275799b3-d570-5db8-85e2-25cf9f9a7f60 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 111603, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty11370', 'expiration_date': '2025-12-06t16:08:33z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '275799b3-d570-5db8-85e2-25cf9f9a7f60', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 111603}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:08:33z',
'fuel_type': 'petrol',
'id': '275799b3-d570-5db8-85e2-25cf9f9a7f60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty11370',
'listing': 'auction',
'location': 'fr, saint-saulve',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 111603,
'odometer_in_km': 111603,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-18',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:08:33Z',
'fuel_type': 'petrol',
'id': '275799b3-d570-5db8-85e2-25cf9f9a7f60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY11370',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Citroen',
'model': 'C3',
'odometer': 111603,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY11370%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [auto1.fr] INFO: Saving data for TY11370: {'auction_closing_time': 1765037313.0, 'created_time': 1764748831.003472, 'last_price_update_time': 1764954081.068305}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY11370') HTTP/1.1" 204 0
2025-12-05 17:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd with identifier: UJ87770
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd with identifier: UJ87770
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190415 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
190415
2025-12-05 17:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd spider: auto1.fr
2025-12-05 17:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd due to rule: high_mileage_for_country.json, error: 190415 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
190415
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:34:40Z',
'fuel_type': 'diesel',
'id': '91dcd722-1b7c-5ab1-aecd-896c8dc6b7dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ87770',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Peugeot',
'model': '3008',
'odometer': 190415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Féline',
'transmission': 'automatic',
'trim': 'Féline',
'year': 2016}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ87770%27 HTTP/1.1" 200 None
2025-12-05 17:01:21 [auto1.fr] INFO: Saving data for UJ87770: {'auction_closing_time': 1765038880.0, 'created_time': 1764842489.69598, 'last_price_update_time': 1764954081.313311}
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UJ87770') HTTP/1.1" 204 0
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN20661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ecad0>
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_78d334f6dab7e3a7f9452818c8261b02.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg saved to cache
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5826390>
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg saved to cache
2025-12-05 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e83910>
2025-12-05 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_40037c26df52a4608d0222301fb726a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH77489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV14610> (referer: https://www.auto1.com/v1/car-details-view/ZV14610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0c510>
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_d06d7edbd9a0151b42557992ba64a6db.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b31790>
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_bf64a79d9759b71e819a97e6a3243107.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV02973> (referer: https://www.auto1.com/v1/car-details-view/KV02973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ42638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW78786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP48063> (referer: https://www.auto1.com/v1/car-details-view/VP48063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ee6110>
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg saved to cache
2025-12-05 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7cad0>
2025-12-05 17:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg saved to cache
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe4f7dfb-a76d-5c87-8a63-26ad574a9723 with identifier: ZV14610
2025-12-05 17:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe4f7dfb-a76d-5c87-8a63-26ad574a9723 with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe4f7dfb-a76d-5c87-8a63-26ad574a9723 with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe4f7dfb-a76d-5c87-8a63-26ad574a9723, identifier: ZV14610
2025-12-05 17:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe4f7dfb-a76d-5c87-8a63-26ad574a9723 with identifier: ZV14610
2025-12-05 17:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe4f7dfb-a76d-5c87-8a63-26ad574a9723 with identifier: ZV14610
2025-12-05 17:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175421 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
175421
2025-12-05 17:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fe4f7dfb-a76d-5c87-8a63-26ad574a9723 spider: auto1.fr
2025-12-05 17:01:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fe4f7dfb-a76d-5c87-8a63-26ad574a9723 due to rule: high_mileage_for_country.json, error: 175421 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
175421
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:35:18Z',
'fuel_type': 'diesel',
'id': 'fe4f7dfb-a76d-5c87-8a63-26ad574a9723',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV14610',
'listing': 'auction',
'location': 'La Ravoire',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 175421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2017}
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV14610%27 HTTP/1.1" 200 None
2025-12-05 17:01:23 [auto1.fr] INFO: Saving data for ZV14610: {'auction_closing_time': 1765038918.0, 'created_time': 1764842747.32542, 'last_price_update_time': 1764954083.563778}
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV14610') HTTP/1.1" 204 0
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB62357> (referer: https://www.auto1.com/v1/car-details-view/HB62357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d60350>
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_fbc198f5e5fb38441be82a873382b272.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg saved to cache
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 with identifier: KV02973
2025-12-05 17:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033, identifier: KV02973
2025-12-05 17:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a869f13-5d6a-532b-b301-ca972cbfb11c with identifier: VP48063
2025-12-05 17:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a869f13-5d6a-532b-b301-ca972cbfb11c with scrape type 2
2025-12-05 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a869f13-5d6a-532b-b301-ca972cbfb11c with scrape type 2
2025-12-05 17:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a869f13-5d6a-532b-b301-ca972cbfb11c, identifier: VP48063
2025-12-05 17:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 with identifier: KV02973
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 with identifier: KV02973
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135251 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
135251
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 spider: auto1.fr
2025-12-05 17:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033 due to rule: high_mileage_for_make.json, error: 135251 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
135251
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:56:11Z',
'fuel_type': 'diesel',
'id': '8e5a01ea-b9d1-5d33-ae73-c2b9e2da1033',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV02973',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Peugeot',
'model': '3008',
'odometer': 135251,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2020}
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV02973%27 HTTP/1.1" 200 None
2025-12-05 17:01:24 [auto1.fr] INFO: Saving data for KV02973: {'auction_closing_time': 1765040171.0, 'created_time': 1764436483.226224, 'last_price_update_time': 1764954084.277506}
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV02973') HTTP/1.1" 204 0
2025-12-05 17:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a869f13-5d6a-532b-b301-ca972cbfb11c with identifier: VP48063
2025-12-05 17:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a869f13-5d6a-532b-b301-ca972cbfb11c with identifier: VP48063
2025-12-05 17:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a869f13-5d6a-532b-b301-ca972cbfb11c with identifier: VP48063 to the API
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP48063>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2025-12-06T16:25:00Z',
'fuel_type': 'diesel',
'id': '5a869f13-5d6a-532b-b301-ca972cbfb11c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP48063',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Peugeot',
'model': '308',
'odometer': 73399,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-08',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2020}
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP48063%27 HTTP/1.1" 200 None
2025-12-05 17:01:24 [auto1.fr] INFO: Saving data for VP48063: {'auction_closing_time': 1765038300.0, 'created_time': 1762277993.143556, 'last_price_update_time': 1764954084.582686}
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VP48063') HTTP/1.1" 204 0
2025-12-05 17:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_14597d875c61ce93d8c116b7f6b0359b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f11c9e28b2b05a1b55060ca7f81e4565.png> (referer: https://www.auto1.com/)
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_c61f7be805a9341eca2e5e9476af7c21.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS57925> (referer: https://www.auto1.com/v1/car-details-view/DS57925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_02c1c26124614cb15f20e37aaa279dd2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c7690>
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg saved to cache
2025-12-05 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ccb10>
2025-12-05 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_146c8bd874642d3cf7a6c240f13152b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg saved to cache
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d76510>
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg saved to cache
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d900e71-a6ee-5580-a134-6e9b614ae236 with identifier: HB62357
2025-12-05 17:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d900e71-a6ee-5580-a134-6e9b614ae236 with scrape type 2
2025-12-05 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d900e71-a6ee-5580-a134-6e9b614ae236 with scrape type 2
2025-12-05 17:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d900e71-a6ee-5580-a134-6e9b614ae236, identifier: HB62357
2025-12-05 17:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d900e71-a6ee-5580-a134-6e9b614ae236 with identifier: HB62357
2025-12-05 17:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d900e71-a6ee-5580-a134-6e9b614ae236 with identifier: HB62357
2025-12-05 17:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 91174, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb62357', 'expiration_date': '2025-12-06t16:10:27z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '1d900e71-a6ee-5580-a134-6e9b614ae236', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 91174}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:10:27z',
'fuel_type': 'petrol',
'id': '1d900e71-a6ee-5580-a134-6e9b614ae236',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb62357',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 91174,
'odometer_in_km': 91174,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-12',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2019}
2025-12-05 17:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1d900e71-a6ee-5580-a134-6e9b614ae236 spider: auto1.fr
2025-12-05 17:01:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1d900e71-a6ee-5580-a134-6e9b614ae236 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 91174, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb62357', 'expiration_date': '2025-12-06t16:10:27z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '1d900e71-a6ee-5580-a134-6e9b614ae236', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 91174}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:10:27z',
'fuel_type': 'petrol',
'id': '1d900e71-a6ee-5580-a134-6e9b614ae236',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb62357',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 91174,
'odometer_in_km': 91174,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-12',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:10:27Z',
'fuel_type': 'petrol',
'id': '1d900e71-a6ee-5580-a134-6e9b614ae236',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB62357',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 91174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB62357%27 HTTP/1.1" 200 None
2025-12-05 17:01:25 [auto1.fr] INFO: Saving data for HB62357: {'auction_closing_time': 1765037427.0, 'created_time': 1762275912.260688, 'last_price_update_time': 1764954085.734613}
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HB62357') HTTP/1.1" 204 0
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71ca516550>
2025-12-05 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_14597d875c61ce93d8c116b7f6b0359b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_14597d875c61ce93d8c116b7f6b0359b.jpg saved to cache
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:26 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:01:26 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:01:26 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:01:26 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ac9010>
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_15.png HTTP/1.1" 201 0
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_f11c9e28b2b05a1b55060ca7f81e4565.png') HTTP/1.1" 204 0
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f11c9e28b2b05a1b55060ca7f81e4565.png saved to cache
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d8d7d0>
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_c61f7be805a9341eca2e5e9476af7c21.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_c61f7be805a9341eca2e5e9476af7c21.jpg saved to cache
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc92dc3-a0ad-5f58-bf6e-1feab478e890 with identifier: DS57925
2025-12-05 17:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc92dc3-a0ad-5f58-bf6e-1feab478e890 with scrape type 2
2025-12-05 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bc92dc3-a0ad-5f58-bf6e-1feab478e890 with scrape type 2
2025-12-05 17:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0bc92dc3-a0ad-5f58-bf6e-1feab478e890, identifier: DS57925
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9ef50>
2025-12-05 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_02c1c26124614cb15f20e37aaa279dd2.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_02c1c26124614cb15f20e37aaa279dd2.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_d5e527010f4c3d65d034efd276e6c6ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0bc92dc3-a0ad-5f58-bf6e-1feab478e890 with identifier: DS57925
2025-12-05 17:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0bc92dc3-a0ad-5f58-bf6e-1feab478e890 with identifier: DS57925
2025-12-05 17:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0bc92dc3-a0ad-5f58-bf6e-1feab478e890 with identifier: DS57925 to the API
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS57925>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:40:01Z',
'fuel_type': 'petrol',
'id': '0bc92dc3-a0ad-5f58-bf6e-1feab478e890',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS57925',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'MINI',
'model': 'MINI',
'odometer': 31926,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-18',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2023}
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS57925%27 HTTP/1.1" 200 None
2025-12-05 17:01:27 [auto1.fr] INFO: Saving data for DS57925: {'auction_closing_time': 1765039201.0, 'created_time': 1764756121.032369, 'last_price_update_time': 1764954087.429431}
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS57925') HTTP/1.1" 204 0
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_6100ea5b8a246678c4c486fc508c06c0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0ec8d9ea75966e38493694c33f521a35.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN42455> (referer: https://www.auto1.com/v1/car-details-view/AN42455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH77489> (referer: https://www.auto1.com/v1/car-details-view/HH77489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU24889> (referer: https://www.auto1.com/v1/car-details-view/EU24889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA69417> (referer: https://www.auto1.com/v1/car-details-view/XA69417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a23f10>
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_d5e527010f4c3d65d034efd276e6c6ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_d5e527010f4c3d65d034efd276e6c6ed.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_8f89f4d0e9d6ee9dc946901688057dde.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_7d5ca5a4fc0ea3ea072d44c1bf9e5326.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV60694> (referer: https://www.auto1.com/v1/car-details-view/VV60694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0ed10>
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_6100ea5b8a246678c4c486fc508c06c0.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_6100ea5b8a246678c4c486fc508c06c0.jpg saved to cache
2025-12-05 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5917810>
2025-12-05 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_0ec8d9ea75966e38493694c33f521a35.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0ec8d9ea75966e38493694c33f521a35.jpg saved to cache
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfbcac7-72c7-5dd3-84d2-e2b870d73358 with identifier: AN42455
2025-12-05 17:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfbcac7-72c7-5dd3-84d2-e2b870d73358 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cfbcac7-72c7-5dd3-84d2-e2b870d73358 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2cfbcac7-72c7-5dd3-84d2-e2b870d73358, identifier: AN42455
2025-12-05 17:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cec770f9-57d8-5854-bdb3-c2e77e6e3884 with identifier: HH77489
2025-12-05 17:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cec770f9-57d8-5854-bdb3-c2e77e6e3884 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cec770f9-57d8-5854-bdb3-c2e77e6e3884 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cec770f9-57d8-5854-bdb3-c2e77e6e3884, identifier: HH77489
2025-12-05 17:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5802b511-01e0-52cd-b53f-51fb8d1367bc with identifier: EU24889
2025-12-05 17:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5802b511-01e0-52cd-b53f-51fb8d1367bc with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5802b511-01e0-52cd-b53f-51fb8d1367bc with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5802b511-01e0-52cd-b53f-51fb8d1367bc, identifier: EU24889
2025-12-05 17:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d98dec9a-6472-5ce1-ba16-45220ac7a642 with identifier: XA69417
2025-12-05 17:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d98dec9a-6472-5ce1-ba16-45220ac7a642 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d98dec9a-6472-5ce1-ba16-45220ac7a642 with scrape type 2
2025-12-05 17:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d98dec9a-6472-5ce1-ba16-45220ac7a642, identifier: XA69417
2025-12-05 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2cfbcac7-72c7-5dd3-84d2-e2b870d73358 with identifier: AN42455
2025-12-05 17:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2cfbcac7-72c7-5dd3-84d2-e2b870d73358 with identifier: AN42455
2025-12-05 17:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2cfbcac7-72c7-5dd3-84d2-e2b870d73358 with identifier: AN42455 to the API
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN42455>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:15:30Z',
'fuel_type': 'diesel',
'id': '2cfbcac7-72c7-5dd3-84d2-e2b870d73358',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN42455',
'listing': 'auction',
'location': 'FR, Camon',
'make': 'Dacia',
'model': 'Duster',
'odometer': 39215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2022}
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN42455%27 HTTP/1.1" 200 None
2025-12-05 17:01:28 [auto1.fr] INFO: Saving data for AN42455: {'auction_closing_time': 1765037730.0, 'created_time': 1764867670.766958, 'last_price_update_time': 1764954088.999675}
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AN42455') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cec770f9-57d8-5854-bdb3-c2e77e6e3884 with identifier: HH77489
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2025-12-05 17:01:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cec770f9-57d8-5854-bdb3-c2e77e6e3884 with identifier: HH77489
2025-12-05 17:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cec770f9-57d8-5854-bdb3-c2e77e6e3884 with identifier: HH77489 to the API
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH77489>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 45,
'expiration_date': '2025-12-06T16:33:20Z',
'fuel_type': 'electro',
'id': 'cec770f9-57d8-5854-bdb3-c2e77e6e3884',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH77489',
'listing': 'auction',
'location': 'Puget-sur-Argens',
'make': 'Dacia',
'model': 'Spring',
'odometer': 16716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-12',
'seats_number': 4,
'seller_name': None,
'title': 'Dacia Spring electric drive 33 kW Expression',
'transmission': 'automatic',
'trim': 'Expression',
'year': 2023}
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH77489%27 HTTP/1.1" 200 None
2025-12-05 17:01:29 [auto1.fr] INFO: Saving data for HH77489: {'auction_closing_time': 1765038800.0, 'created_time': 1764842733.018909, 'last_price_update_time': 1764954089.497264}
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HH77489') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5802b511-01e0-52cd-b53f-51fb8d1367bc with identifier: EU24889
2025-12-05 17:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5802b511-01e0-52cd-b53f-51fb8d1367bc with identifier: EU24889
2025-12-05 17:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.2 puretech plus', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 5133, 'odometer_reading_unit': 'km', 'registration_date': '2024-07-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eu24889', 'expiration_date': '2025-12-06t16:26:00z', 'origin_country_code': 'fr', 'trim': 'plus', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 137, 'id': '5802b511-01e0-52cd-b53f-51fb8d1367bc', 'current_year_diff': 1, 'age_in_months': 16, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 5133}
Failed validating None in schema:
False
On instance:
{'age_in_months': 16,
'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:26:00z',
'fuel_type': 'petrol',
'id': '5802b511-01e0-52cd-b53f-51fb8d1367bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eu24889',
'listing': 'auction',
'location': 'fr, beaucaire',
'make': 'citroen',
'make_model': 'citroen c5 x',
'model': 'c5 x',
'odometer': 5133,
'odometer_in_km': 5133,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-07-28',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c5 x 1.2 puretech plus',
'transmission': 'automatic',
'trim': 'plus',
'year': 2024}
2025-12-05 17:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5802b511-01e0-52cd-b53f-51fb8d1367bc spider: auto1.fr
2025-12-05 17:01:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5802b511-01e0-52cd-b53f-51fb8d1367bc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.2 puretech plus', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 5133, 'odometer_reading_unit': 'km', 'registration_date': '2024-07-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eu24889', 'expiration_date': '2025-12-06t16:26:00z', 'origin_country_code': 'fr', 'trim': 'plus', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 137, 'id': '5802b511-01e0-52cd-b53f-51fb8d1367bc', 'current_year_diff': 1, 'age_in_months': 16, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 5133}
Failed validating None in schema:
False
On instance:
{'age_in_months': 16,
'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:26:00z',
'fuel_type': 'petrol',
'id': '5802b511-01e0-52cd-b53f-51fb8d1367bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eu24889',
'listing': 'auction',
'location': 'fr, beaucaire',
'make': 'citroen',
'make_model': 'citroen c5 x',
'model': 'c5 x',
'odometer': 5133,
'odometer_in_km': 5133,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-07-28',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c5 x 1.2 puretech plus',
'transmission': 'automatic',
'trim': 'plus',
'year': 2024}
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:26:00Z',
'fuel_type': 'petrol',
'id': '5802b511-01e0-52cd-b53f-51fb8d1367bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU24889',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Citroen',
'model': 'C5 X',
'odometer': 5133,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 X 1.2 PureTech Plus',
'transmission': 'automatic',
'trim': 'Plus',
'year': 2024}
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU24889%27 HTTP/1.1" 200 None
2025-12-05 17:01:29 [auto1.fr] INFO: Saving data for EU24889: {'auction_closing_time': 1765038360.0, 'created_time': 1762276492.166852, 'last_price_update_time': 1764954089.705213}
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU24889') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d98dec9a-6472-5ce1-ba16-45220ac7a642 with identifier: XA69417
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2025-12-05 17:01:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d98dec9a-6472-5ce1-ba16-45220ac7a642 with identifier: XA69417
2025-12-05 17:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d98dec9a-6472-5ce1-ba16-45220ac7a642 with identifier: XA69417 to the API
2025-12-05 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XA69417>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:53:10Z',
'fuel_type': 'gas',
'id': 'd98dec9a-6472-5ce1-ba16-45220ac7a642',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA69417',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Captur',
'odometer': 31252,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.0 TCe LPG Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2022}
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA69417%27 HTTP/1.1" 200 None
2025-12-05 17:01:30 [auto1.fr] INFO: Saving data for XA69417: {'auction_closing_time': 1765039990.0, 'created_time': 1764695039.416041, 'last_price_update_time': 1764954090.171061}
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XA69417') HTTP/1.1" 204 0
2025-12-05 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_588ae49391e8a75734117b7009a7ab29.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f57e6471e2009160ec995233f4fdd648.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_1264ac590b960b09363d4a8713bfe45c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ42638> (referer: https://www.auto1.com/v1/car-details-view/YJ42638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN20661> (referer: https://www.auto1.com/v1/car-details-view/NN20661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW78786> (referer: https://www.auto1.com/v1/car-details-view/EW78786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592f910>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_8f89f4d0e9d6ee9dc946901688057dde.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_8f89f4d0e9d6ee9dc946901688057dde.jpg saved to cache
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d77950>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_7d5ca5a4fc0ea3ea072d44c1bf9e5326.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_7d5ca5a4fc0ea3ea072d44c1bf9e5326.jpg saved to cache
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ba7d295-3500-5420-b618-9784c5ad86c4 with identifier: VV60694
2025-12-05 17:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ba7d295-3500-5420-b618-9784c5ad86c4 with scrape type 2
2025-12-05 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ba7d295-3500-5420-b618-9784c5ad86c4 with scrape type 2
2025-12-05 17:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ba7d295-3500-5420-b618-9784c5ad86c4, identifier: VV60694
2025-12-05 17:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0d4d0>
2025-12-05 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_3959ef8184a04ebf155ad9c7594313f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg saved to cache
2025-12-05 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ba7d295-3500-5420-b618-9784c5ad86c4 with identifier: VV60694
2025-12-05 17:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ba7d295-3500-5420-b618-9784c5ad86c4 with identifier: VV60694
2025-12-05 17:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8ba7d295-3500-5420-b618-9784c5ad86c4 with identifier: VV60694 to the API
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV60694>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:05:31Z',
'fuel_type': 'gas',
'id': '8ba7d295-3500-5420-b618-9784c5ad86c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV60694',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Captur',
'odometer': 18219,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.0 TCe LPG Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2022}
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV60694%27 HTTP/1.1" 200 None
2025-12-05 17:01:31 [auto1.fr] INFO: Saving data for VV60694: {'auction_closing_time': 1765037131.0, 'created_time': 1764695078.366054, 'last_price_update_time': 1764954091.649919}
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV60694') HTTP/1.1" 204 0
2025-12-05 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d6cd50>
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_588ae49391e8a75734117b7009a7ab29.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_588ae49391e8a75734117b7009a7ab29.jpg saved to cache
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9ca50>
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_f57e6471e2009160ec995233f4fdd648.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f57e6471e2009160ec995233f4fdd648.jpg saved to cache
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5976650>
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_1264ac590b960b09363d4a8713bfe45c.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_1264ac590b960b09363d4a8713bfe45c.jpg saved to cache
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f39c5b6-62b8-57ac-b16c-c58c724315d6 with identifier: YJ42638
2025-12-05 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f39c5b6-62b8-57ac-b16c-c58c724315d6 with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f39c5b6-62b8-57ac-b16c-c58c724315d6 with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f39c5b6-62b8-57ac-b16c-c58c724315d6, identifier: YJ42638
2025-12-05 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11838276-e25a-582b-87af-2544244e56af with identifier: NN20661
2025-12-05 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11838276-e25a-582b-87af-2544244e56af with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11838276-e25a-582b-87af-2544244e56af with scrape type 2
2025-12-05 17:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 11838276-e25a-582b-87af-2544244e56af, identifier: NN20661
2025-12-05 17:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591b8d0>
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_78bdeff759ef30058c23d83af94188ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg saved to cache
2025-12-05 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92408844-e633-5c0e-aad9-e12e61630fcd with identifier: EW78786
2025-12-05 17:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92408844-e633-5c0e-aad9-e12e61630fcd with scrape type 2
2025-12-05 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92408844-e633-5c0e-aad9-e12e61630fcd with scrape type 2
2025-12-05 17:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 92408844-e633-5c0e-aad9-e12e61630fcd, identifier: EW78786
2025-12-05 17:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f39c5b6-62b8-57ac-b16c-c58c724315d6 with identifier: YJ42638
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f39c5b6-62b8-57ac-b16c-c58c724315d6 with identifier: YJ42638
2025-12-05 17:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f39c5b6-62b8-57ac-b16c-c58c724315d6 with identifier: YJ42638 to the API
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ42638>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 184,
'expiration_date': '2025-12-06T16:18:44Z',
'fuel_type': 'electro',
'id': '9f39c5b6-62b8-57ac-b16c-c58c724315d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ42638',
'listing': 'auction',
'location': 'FR, Antibes',
'make': 'MINI',
'model': 'MINI',
'odometer': 36647,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-23',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper SE Essential Trim',
'transmission': 'automatic',
'trim': 'Essential Trim',
'year': 2021}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ42638%27 HTTP/1.1" 200 None
2025-12-05 17:01:33 [auto1.fr] INFO: Saving data for YJ42638: {'auction_closing_time': 1765037924.0, 'created_time': 1764756139.718861, 'last_price_update_time': 1764954093.537807}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ42638') HTTP/1.1" 204 0
2025-12-05 17:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 11838276-e25a-582b-87af-2544244e56af with identifier: NN20661
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 11838276-e25a-582b-87af-2544244e56af with identifier: NN20661
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 75523, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nn20661', 'expiration_date': '2025-12-06t16:34:48z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '11838276-e25a-582b-87af-2544244e56af', 'current_year_diff': 4, 'age_in_months': 53, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 75523}
Failed validating None in schema:
False
On instance:
{'age_in_months': 53,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:34:48z',
'fuel_type': 'petrol',
'id': '11838276-e25a-582b-87af-2544244e56af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nn20661',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 75523,
'odometer_in_km': 75523,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 11838276-e25a-582b-87af-2544244e56af spider: auto1.fr
2025-12-05 17:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 11838276-e25a-582b-87af-2544244e56af due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 75523, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nn20661', 'expiration_date': '2025-12-06t16:34:48z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '11838276-e25a-582b-87af-2544244e56af', 'current_year_diff': 4, 'age_in_months': 53, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 75523}
Failed validating None in schema:
False
On instance:
{'age_in_months': 53,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:34:48z',
'fuel_type': 'petrol',
'id': '11838276-e25a-582b-87af-2544244e56af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nn20661',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 75523,
'odometer_in_km': 75523,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:34:48Z',
'fuel_type': 'petrol',
'id': '11838276-e25a-582b-87af-2544244e56af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN20661',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': '2008',
'odometer': 75523,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN20661%27 HTTP/1.1" 200 None
2025-12-05 17:01:33 [auto1.fr] INFO: Saving data for NN20661: {'auction_closing_time': 1765038888.0, 'created_time': 1764842646.904795, 'last_price_update_time': 1764954093.777272}
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN20661') HTTP/1.1" 204 0
2025-12-05 17:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 92408844-e633-5c0e-aad9-e12e61630fcd with identifier: EW78786
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 92408844-e633-5c0e-aad9-e12e61630fcd with identifier: EW78786
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195491 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195491
2025-12-05 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 92408844-e633-5c0e-aad9-e12e61630fcd spider: auto1.fr
2025-12-05 17:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 92408844-e633-5c0e-aad9-e12e61630fcd due to rule: high_mileage_for_country.json, error: 195491 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195491
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:59:20Z',
'fuel_type': 'diesel',
'id': '92408844-e633-5c0e-aad9-e12e61630fcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW78786',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 195491,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2017}
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW78786%27 HTTP/1.1" 200 None
2025-12-05 17:01:34 [auto1.fr] INFO: Saving data for EW78786: {'auction_closing_time': 1765040360.0, 'created_time': 1763658686.748306, 'last_price_update_time': 1764954094.01042}
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW78786') HTTP/1.1" 204 0
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY09036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM91260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX85302> (referer: https://www.auto1.com/v1/car-details-view/PX85302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_afac44909a1975abe537a7e11e345563.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0a207a2ee80c52525549486adb2d4958.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cd47eb-6c3d-5d68-88f0-760125228ab5 with identifier: PX85302
2025-12-05 17:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cd47eb-6c3d-5d68-88f0-760125228ab5 with scrape type 2
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34cd47eb-6c3d-5d68-88f0-760125228ab5 with scrape type 2
2025-12-05 17:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 34cd47eb-6c3d-5d68-88f0-760125228ab5, identifier: PX85302
2025-12-05 17:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 34cd47eb-6c3d-5d68-88f0-760125228ab5 with identifier: PX85302
2025-12-05 17:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 34cd47eb-6c3d-5d68-88f0-760125228ab5 with identifier: PX85302
2025-12-05 17:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188722 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
188722
2025-12-05 17:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 34cd47eb-6c3d-5d68-88f0-760125228ab5 spider: auto1.fr
2025-12-05 17:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 34cd47eb-6c3d-5d68-88f0-760125228ab5 due to rule: high_mileage_for_country.json, error: 188722 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
188722
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:05:12Z',
'fuel_type': 'diesel',
'id': '34cd47eb-6c3d-5d68-88f0-760125228ab5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX85302',
'listing': 'auction',
'location': 'FR, Agen',
'make': 'Dacia',
'model': 'Duster',
'odometer': 188722,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2019}
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX85302%27 HTTP/1.1" 200 None
2025-12-05 17:01:34 [auto1.fr] INFO: Saving data for PX85302: {'auction_closing_time': 1765037112.0, 'created_time': 1764756246.2766, 'last_price_update_time': 1764954094.46638}
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX85302') HTTP/1.1" 204 0
2025-12-05 17:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c98d0>
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg saved to cache
2025-12-05 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a22890>
2025-12-05 17:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F78%252Ffc784b3a1e089b6a9aa7dd63e0dbeff1%252Fpa%252FVV81985_94c9aa796628097a133711c95850938b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg saved to cache
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf
2025-12-05 17:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf, skipping ID generation
2025-12-05 17:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf with scrape type 1
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf from tracking dictionaries
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf sending to next pipeline
2025-12-05 17:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf, identifier: VV81985
2025-12-05 17:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a227d0>
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_afac44909a1975abe537a7e11e345563.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_afac44909a1975abe537a7e11e345563.jpg saved to cache
2025-12-05 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ff350>
2025-12-05 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_0a207a2ee80c52525549486adb2d4958.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0a207a2ee80c52525549486adb2d4958.jpg saved to cache
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da0dd0>
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa8%252Fe9a8e4be00fab9c04d6434ccf8afe1ad%252Fpa%252FUE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg saved to cache
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70642db3-3977-5909-a253-c5e72806df0b
2025-12-05 17:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70642db3-3977-5909-a253-c5e72806df0b, skipping ID generation
2025-12-05 17:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70642db3-3977-5909-a253-c5e72806df0b with scrape type 1
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70642db3-3977-5909-a253-c5e72806df0b from tracking dictionaries
2025-12-05 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70642db3-3977-5909-a253-c5e72806df0b sending to next pipeline
2025-12-05 17:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70642db3-3977-5909-a253-c5e72806df0b, identifier: UE09620
2025-12-05 17:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf with identifier: VV81985
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf with identifier: VV81985
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500c 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500c', 'transmission': 'automatic', 'odometer': 148793, 'odometer_reading_unit': 'km', 'registration_date': '2016-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv81985', 'expiration_date': '2025-12-06t16:07:51z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 2, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boulogne-billancourt', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 111, 'id': '1450ecaa-738a-5a21-ae33-30a2c4a6e9bf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2421952}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2457026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61852}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53541}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57190}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54762}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60701}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2393525}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48488}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60275}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2310150}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 29432}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52638}], 'current_year_diff': 9, 'age_in_months': 109, 'make_model': 'fiat 500c', 'sanitized_make': 'fiat', 'odometer_in_km': 148793}
Failed validating None in schema:
False
On instance:
{'age_in_months': 109,
'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 2,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 70,
'expiration_date': '2025-12-06t16:07:51z',
'fuel_type': 'petrol',
'id': '1450ecaa-738a-5a21-ae33-30a2c4a6e9bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv81985',
'listing': 'auction',
'location': 'fr, boulogne-billancourt',
'make': 'fiat',
'make_model': 'fiat 500c',
'model': '500c',
'odometer': 148793,
'odometer_in_km': 148793,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421952,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457026,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2393525,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310150,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-13',
'sanitized_make': 'fiat',
'seats_number': 4,
'seller_name': None,
'title': 'fiat 500c 1.2 lounge',
'transmission': 'automatic',
'trim': 'lounge',
'year': 2016}
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf spider: auto1.fr
2025-12-05 17:01:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1450ecaa-738a-5a21-ae33-30a2c4a6e9bf due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500c 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500c', 'transmission': 'automatic', 'odometer': 148793, 'odometer_reading_unit': 'km', 'registration_date': '2016-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv81985', 'expiration_date': '2025-12-06t16:07:51z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 2, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boulogne-billancourt', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 111, 'id': '1450ecaa-738a-5a21-ae33-30a2c4a6e9bf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2421952}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2457026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61852}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53541}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57190}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54762}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60701}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2393525}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48488}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60275}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2310150}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 29432}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52638}], 'current_year_diff': 9, 'age_in_months': 109, 'make_model': 'fiat 500c', 'sanitized_make': 'fiat', 'odometer_in_km': 148793}
Failed validating None in schema:
False
On instance:
{'age_in_months': 109,
'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 2,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 70,
'expiration_date': '2025-12-06t16:07:51z',
'fuel_type': 'petrol',
'id': '1450ecaa-738a-5a21-ae33-30a2c4a6e9bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv81985',
'listing': 'auction',
'location': 'fr, boulogne-billancourt',
'make': 'fiat',
'make_model': 'fiat 500c',
'model': '500c',
'odometer': 148793,
'odometer_in_km': 148793,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421952,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457026,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2393525,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310150,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-13',
'sanitized_make': 'fiat',
'seats_number': 4,
'seller_name': None,
'title': 'fiat 500c 1.2 lounge',
'transmission': 'automatic',
'trim': 'lounge',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:07:51Z',
'fuel_type': 'petrol',
'id': '1450ecaa-738a-5a21-ae33-30a2c4a6e9bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV81985',
'listing': 'auction',
'location': 'FR, Boulogne-Billancourt',
'make': 'Fiat',
'model': '500C',
'odometer': 148793,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421952,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_94c9aa796628097a133711c95850938b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457026,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_dd538e0ec0f46a5ccae841ac20a3dcfb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_270e5e741fa443d51b35fc415e1f3fd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_146c8bd874642d3cf7a6c240f13152b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_77b5e7dcc598ee27e4359d2eae16593c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_f3665556ddeca0f740354bcc26362932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_fbc198f5e5fb38441be82a873382b272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c7505885c706ec8d11f38750e3b8d2c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2393525,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78bdeff759ef30058c23d83af94188ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_c46234b1eae081d1e2379fbfdf959f8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_78d334f6dab7e3a7f9452818c8261b02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310150,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_3959ef8184a04ebf155ad9c7594313f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_40037c26df52a4608d0222301fb726a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_e05c6b7305905bc4d535c1408ce0fc43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_d06d7edbd9a0151b42557992ba64a6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1450ecaa-738a-5a21-ae33-30a2c4a6e9bf/1450ecaa-738a-5a21-ae33-30a2c4a6e9bf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/78/fc784b3a1e089b6a9aa7dd63e0dbeff1/pa/VV81985_bf64a79d9759b71e819a97e6a3243107.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-13',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 1.2 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2016}
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV81985%27 HTTP/1.1" 200 None
2025-12-05 17:01:36 [auto1.fr] INFO: Saving data for VV81985: {'created_time': 1764954096.903217, 'last_price_update_time': 1764954096.903229, 'auction_closing_time': 1765037271.0}
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV81985') HTTP/1.1" 204 0
2025-12-05 17:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70642db3-3977-5909-a253-c5e72806df0b with identifier: UE09620
2025-12-05 17:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70642db3-3977-5909-a253-c5e72806df0b with identifier: UE09620
2025-12-05 17:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70642db3-3977-5909-a253-c5e72806df0b with identifier: UE09620 to the API
2025-12-05 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:22:23Z',
'fuel_type': 'gas',
'id': '70642db3-3977-5909-a253-c5e72806df0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE09620',
'listing': 'auction',
'location': 'FR, Manosque',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 8543,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3232719,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_901b69d1e7413b8dcecf13f155f83f6b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3198190,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0a207a2ee80c52525549486adb2d4958.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f57e6471e2009160ec995233f4fdd648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_1264ac590b960b09363d4a8713bfe45c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_588ae49391e8a75734117b7009a7ab29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_8f89f4d0e9d6ee9dc946901688057dde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0c3c1dd4a54814a10245476598a29be7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_7d5ca5a4fc0ea3ea072d44c1bf9e5326.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_0ec8d9ea75966e38493694c33f521a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_6100ea5b8a246678c4c486fc508c06c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_d5e527010f4c3d65d034efd276e6c6ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3114540,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_afac44909a1975abe537a7e11e345563.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_02c1c26124614cb15f20e37aaa279dd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_14597d875c61ce93d8c116b7f6b0359b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_c61f7be805a9341eca2e5e9476af7c21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70642db3-3977-5909-a253-c5e72806df0b/70642db3-3977-5909-a253-c5e72806df0b_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 76910,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imge9/a8/e9a8e4be00fab9c04d6434ccf8afe1ad/pa/UE09620_f11c9e28b2b05a1b55060ca7f81e4565.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Extreme',
'transmission': 'manual',
'trim': 'Stepway Extreme',
'year': 2024}
2025-12-05 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE09620%27 HTTP/1.1" 200 None
2025-12-05 17:01:38 [auto1.fr] INFO: Saving data for UE09620: {'created_time': 1764954098.999552, 'last_price_update_time': 1764954098.999561, 'auction_closing_time': 1765038143.0}
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UE09620') HTTP/1.1" 204 0
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US26659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM70130> (referer: https://www.auto1.com/v1/car-details-view/EM70130/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF79780> (referer: https://www.auto1.com/v1/car-details-view/CF79780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA14498> (referer: https://www.auto1.com/v1/car-details-view/PA14498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:39 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:39 [auto1.fr] INFO: Found listing with ID: FS90726
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS90726%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.fr] INFO: Scrape type for FS90726: 0
2025-12-05 17:01:39 [auto1.fr] INFO: Found listing with ID: YX39398
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX39398%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.fr] INFO: Scrape type for YX39398: 0
2025-12-05 17:01:39 [auto1.fr] INFO: Found listing with ID: JF35414
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF35414%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.fr] INFO: Scrape type for JF35414: 2
2025-12-05 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e87b7f3f-af48-5367-84dd-58ac93775b7d with identifier: EM70130
2025-12-05 17:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87b7f3f-af48-5367-84dd-58ac93775b7d with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e87b7f3f-af48-5367-84dd-58ac93775b7d with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e87b7f3f-af48-5367-84dd-58ac93775b7d, identifier: EM70130
2025-12-05 17:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db0c4a37-a6ae-50dd-bc9f-7727565ebb10 with identifier: CF79780
2025-12-05 17:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10 with scrape type 1
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_46bf3bfc0cf6178e3c909a854c8fec90.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_46bf3bfc0cf6178e3c909a854c8fec90.jpg not downloaded yet
2025-12-05 17:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d29173c-18b4-5f5e-afd8-6b14731e76f9 with identifier: PA14498
2025-12-05 17:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d29173c-18b4-5f5e-afd8-6b14731e76f9 with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d29173c-18b4-5f5e-afd8-6b14731e76f9 with scrape type 2
2025-12-05 17:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d29173c-18b4-5f5e-afd8-6b14731e76f9, identifier: PA14498
2025-12-05 17:01:39 [auto1.fr] INFO: Found listing with ID: XX15760
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX15760%27 HTTP/1.1" 200 None
2025-12-05 17:01:39 [auto1.fr] INFO: Scrape type for XX15760: 2
2025-12-05 17:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e87b7f3f-af48-5367-84dd-58ac93775b7d with identifier: EM70130
2025-12-05 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e87b7f3f-af48-5367-84dd-58ac93775b7d with identifier: EM70130
2025-12-05 17:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e87b7f3f-af48-5367-84dd-58ac93775b7d with identifier: EM70130 to the API
2025-12-05 17:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM70130>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:53:46Z',
'fuel_type': 'diesel',
'id': 'e87b7f3f-af48-5367-84dd-58ac93775b7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM70130',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Peugeot',
'model': '2008',
'odometer': 60797,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2021}
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM70130%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.fr] INFO: Saving data for EM70130: {'auction_closing_time': 1765040026.0, 'created_time': 1762881037.012355, 'last_price_update_time': 1764954100.534834}
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EM70130') HTTP/1.1" 204 0
2025-12-05 17:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d29173c-18b4-5f5e-afd8-6b14731e76f9 with identifier: PA14498
2025-12-05 17:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d29173c-18b4-5f5e-afd8-6b14731e76f9 with identifier: PA14498
2025-12-05 17:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d29173c-18b4-5f5e-afd8-6b14731e76f9 with identifier: PA14498 to the API
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PA14498>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:16:56Z',
'fuel_type': 'diesel',
'id': '2d29173c-18b4-5f5e-afd8-6b14731e76f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA14498',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'BMW',
'model': '5er',
'odometer': 110468,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA14498%27 HTTP/1.1" 200 None
2025-12-05 17:01:40 [auto1.fr] INFO: Saving data for PA14498: {'auction_closing_time': 1765037816.0, 'created_time': 1764050454.026328, 'last_price_update_time': 1764954100.996647}
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PA14498') HTTP/1.1" 204 0
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_d6f950213857dfb5de98352542fc33d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d6f950213857dfb5de98352542fc33d3.jpg not downloaded yet
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: NK49405
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK49405%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for NK49405: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: PH21838
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH21838%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for PH21838: 2
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_8de8986d186d8efaff70e3f6046899bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8de8986d186d8efaff70e3f6046899bc.jpg not downloaded yet
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS51600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW96531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG68439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: NX19828
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX19828%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for NX19828: 1
2025-12-05 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_5e578d2562a2c5b3de5526532c87c0ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_5e578d2562a2c5b3de5526532c87c0ce.jpg not downloaded yet
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: EB05024
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB05024%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for EB05024: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: ES56292
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES56292%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for ES56292: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: FA42307
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA42307%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for FA42307: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: UC94844
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC94844%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for UC94844: 2
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_07d2f2a817838e059b0e8d800eaf8686.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_07d2f2a817838e059b0e8d800eaf8686.jpg not downloaded yet
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_46bf3bfc0cf6178e3c909a854c8fec90.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d6f950213857dfb5de98352542fc33d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: BA08983
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA08983%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for BA08983: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: RD60293
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD60293%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for RD60293: 2
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_baa19ff50ebb68ce2d64f452db34f3a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_baa19ff50ebb68ce2d64f452db34f3a9.jpg not downloaded yet
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: JP15071
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP15071%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for JP15071: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: CC66961
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC66961%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for CC66961: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: XS91085
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS91085%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for XS91085: 2
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_480b2490b0afd92fd52bb0e78ed550e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_480b2490b0afd92fd52bb0e78ed550e6.jpg not downloaded yet
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: CH56845
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH56845%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for CH56845: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: MW09628
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW09628%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for MW09628: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: PY80506
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY80506%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for PY80506: 0
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: EH01560
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH01560%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for EH01560: 1
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8de8986d186d8efaff70e3f6046899bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_acf8171ed69e2caf216363e01d0eb8c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_acf8171ed69e2caf216363e01d0eb8c6.jpg not downloaded yet
2025-12-05 17:01:41 [auto1.fr] INFO: Found listing with ID: HW89332
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW89332%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [auto1.fr] INFO: Scrape type for HW89332: 2
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58813d0>
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_46bf3bfc0cf6178e3c909a854c8fec90.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_46bf3bfc0cf6178e3c909a854c8fec90.jpg saved to cache
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d518d0>
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_d6f950213857dfb5de98352542fc33d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d6f950213857dfb5de98352542fc33d3.jpg saved to cache
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_07d2f2a817838e059b0e8d800eaf8686.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_5e578d2562a2c5b3de5526532c87c0ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_93438d37bf367e84f42fb0dfc0474e91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_93438d37bf367e84f42fb0dfc0474e91.jpg not downloaded yet
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: TZ67118
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ67118%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for TZ67118: 2
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_350fd6d2e8c4791948fe887190db8e00.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_350fd6d2e8c4791948fe887190db8e00.jpg not downloaded yet
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS14045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c586ce90>
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_8de8986d186d8efaff70e3f6046899bc.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8de8986d186d8efaff70e3f6046899bc.jpg saved to cache
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: PJ24494
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ24494%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for PJ24494: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: JU46598
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU46598%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for JU46598: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: FU31007
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU31007%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for FU31007: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: XV79309
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV79309%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for XV79309: 1
2025-12-05 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_480b2490b0afd92fd52bb0e78ed550e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_c54f25d6dbedd05780053cc24454f4cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_c54f25d6dbedd05780053cc24454f4cc.jpg not downloaded yet
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_acf8171ed69e2caf216363e01d0eb8c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: VV53212
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV53212%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for VV53212: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: EZ34452
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ34452%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for EZ34452: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: KL38696
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL38696%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for KL38696: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: FM35495
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM35495%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for FM35495: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: XJ30898
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ30898%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for XJ30898: 2
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM91260> (referer: https://www.auto1.com/v1/car-details-view/VM91260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US26659> (referer: https://www.auto1.com/v1/car-details-view/US26659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST01655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY09036> (referer: https://www.auto1.com/v1/car-details-view/RY09036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_8d638007e9941a05f7fd1cad934af685.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8d638007e9941a05f7fd1cad934af685.jpg not downloaded yet
2025-12-05 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: AR36974
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR36974%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for AR36974: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: SF95659
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF95659%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for SF95659: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: FM34234
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM34234%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for FM34234: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: PM26865
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM26865%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for PM26865: 0
2025-12-05 17:01:42 [auto1.fr] INFO: Found listing with ID: KF05185
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF05185%27 HTTP/1.1" 200 None
2025-12-05 17:01:42 [auto1.fr] INFO: Scrape type for KF05185: 2
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f18750>
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_07d2f2a817838e059b0e8d800eaf8686.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_07d2f2a817838e059b0e8d800eaf8686.jpg saved to cache
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c587aed0>
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_5e578d2562a2c5b3de5526532c87c0ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_5e578d2562a2c5b3de5526532c87c0ce.jpg saved to cache
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_3379c84bd688718fa63e78d4d20dd657.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_3379c84bd688718fa63e78d4d20dd657.jpg not downloaded yet
2025-12-05 17:01:43 [auto1.fr] INFO: Found listing with ID: ZK21944
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK21944%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.fr] INFO: Scrape type for ZK21944: 0
2025-12-05 17:01:43 [auto1.fr] INFO: Found listing with ID: DB91824
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB91824%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.fr] INFO: Scrape type for DB91824: 0
2025-12-05 17:01:43 [auto1.fr] INFO: Found listing with ID: HX38280
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX38280%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.fr] INFO: Scrape type for HX38280: 0
2025-12-05 17:01:43 [auto1.fr] INFO: Found listing with ID: GR54151
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR54151%27 HTTP/1.1" 200 None
2025-12-05 17:01:43 [auto1.fr] INFO: Scrape type for GR54151: 0
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a5750>
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_480b2490b0afd92fd52bb0e78ed550e6.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_480b2490b0afd92fd52bb0e78ed550e6.jpg saved to cache
2025-12-05 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58411d0>
2025-12-05 17:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_acf8171ed69e2caf216363e01d0eb8c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_acf8171ed69e2caf216363e01d0eb8c6.jpg saved to cache
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_350fd6d2e8c4791948fe887190db8e00.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_207dbf8c5ddf399bcb8fa5ed81d88c96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_207dbf8c5ddf399bcb8fa5ed81d88c96.jpg not downloaded yet
2025-12-05 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX15760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF35414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 195776f6-4ce8-5777-a4f5-4e165b2b3fe2 with identifier: VM91260
2025-12-05 17:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 195776f6-4ce8-5777-a4f5-4e165b2b3fe2 with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 195776f6-4ce8-5777-a4f5-4e165b2b3fe2 with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 195776f6-4ce8-5777-a4f5-4e165b2b3fe2, identifier: VM91260
2025-12-05 17:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a with identifier: US26659
2025-12-05 17:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a, identifier: US26659
2025-12-05 17:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e266c2a-f013-5802-9460-909357f88d6c with identifier: RY09036
2025-12-05 17:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e266c2a-f013-5802-9460-909357f88d6c with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e266c2a-f013-5802-9460-909357f88d6c with scrape type 2
2025-12-05 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5e266c2a-f013-5802-9460-909357f88d6c, identifier: RY09036
2025-12-05 17:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 195776f6-4ce8-5777-a4f5-4e165b2b3fe2 with identifier: VM91260
2025-12-05 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 195776f6-4ce8-5777-a4f5-4e165b2b3fe2 with identifier: VM91260
2025-12-05 17:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 195776f6-4ce8-5777-a4f5-4e165b2b3fe2 with identifier: VM91260 to the API
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM91260>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:39:55Z',
'fuel_type': 'petrol',
'id': '195776f6-4ce8-5777-a4f5-4e165b2b3fe2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM91260',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Seat',
'model': 'Arona',
'odometer': 141920,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Arona 1.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2020}
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM91260%27 HTTP/1.1" 200 None
2025-12-05 17:01:44 [auto1.fr] INFO: Saving data for VM91260: {'auction_closing_time': 1765039195.0, 'created_time': 1764842497.677991, 'last_price_update_time': 1764954104.972831}
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VM91260') HTTP/1.1" 204 0
2025-12-05 17:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a with identifier: US26659
2025-12-05 17:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a with identifier: US26659
2025-12-05 17:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 69538, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us26659', 'expiration_date': '2025-12-06t16:16:52z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marckolsheim', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 141, 'id': '2c406afc-38f0-5bbf-88b3-f642d0f0cb5a', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 69538}
Failed validating None in schema:
False
On instance:
{'age_in_months': 59,
'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:16:52z',
'fuel_type': 'petrol',
'id': '2c406afc-38f0-5bbf-88b3-f642d0f0cb5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us26659',
'listing': 'auction',
'location': 'fr, marckolsheim',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 69538,
'odometer_in_km': 69538,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-06',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt line',
'transmission': 'automatic',
'trim': 'gt line',
'year': 2020}
2025-12-05 17:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a spider: auto1.fr
2025-12-05 17:01:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2c406afc-38f0-5bbf-88b3-f642d0f0cb5a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 69538, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us26659', 'expiration_date': '2025-12-06t16:16:52z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marckolsheim', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 141, 'id': '2c406afc-38f0-5bbf-88b3-f642d0f0cb5a', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 69538}
Failed validating None in schema:
False
On instance:
{'age_in_months': 59,
'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:16:52z',
'fuel_type': 'petrol',
'id': '2c406afc-38f0-5bbf-88b3-f642d0f0cb5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us26659',
'listing': 'auction',
'location': 'fr, marckolsheim',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 69538,
'odometer_in_km': 69538,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-06',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt line',
'transmission': 'automatic',
'trim': 'gt line',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:16:52Z',
'fuel_type': 'petrol',
'id': '2c406afc-38f0-5bbf-88b3-f642d0f0cb5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US26659',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Peugeot',
'model': '2008',
'odometer': 69538,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US26659%27 HTTP/1.1" 200 None
2025-12-05 17:01:45 [auto1.fr] INFO: Saving data for US26659: {'auction_closing_time': 1765037812.0, 'created_time': 1764756026.493206, 'last_price_update_time': 1764954105.311997}
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US26659') HTTP/1.1" 204 0
2025-12-05 17:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5e266c2a-f013-5802-9460-909357f88d6c with identifier: RY09036
2025-12-05 17:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5e266c2a-f013-5802-9460-909357f88d6c with identifier: RY09036
2025-12-05 17:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5e266c2a-f013-5802-9460-909357f88d6c with identifier: RY09036 to the API
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY09036>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:13:00Z',
'fuel_type': 'petrol',
'id': '5e266c2a-f013-5802-9460-909357f88d6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY09036',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'BMW',
'model': '1er',
'odometer': 70249,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116i UrbanChic',
'transmission': 'manual',
'trim': 'UrbanChic',
'year': 2018}
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY09036%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.fr] INFO: Saving data for RY09036: {'auction_closing_time': 1765037580.0, 'created_time': 1764842494.452665, 'last_price_update_time': 1764954106.076942}
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY09036') HTTP/1.1" 204 0
2025-12-05 17:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_93438d37bf367e84f42fb0dfc0474e91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_c54f25d6dbedd05780053cc24454f4cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_aff4cad4f144303a699da65f96618956.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_aff4cad4f144303a699da65f96618956.jpg not downloaded yet
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e75950>
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_350fd6d2e8c4791948fe887190db8e00.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_350fd6d2e8c4791948fe887190db8e00.jpg saved to cache
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:46 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_e8b3a81d253e4778e8f01ae13418fbec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_e8b3a81d253e4778e8f01ae13418fbec.jpg not downloaded yet
2025-12-05 17:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_3379c84bd688718fa63e78d4d20dd657.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8d638007e9941a05f7fd1cad934af685.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:46 [auto1.fr] INFO: Found listing with ID: TD25182
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD25182%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.fr] INFO: Scrape type for TD25182: 0
2025-12-05 17:01:46 [auto1.fr] INFO: Found listing with ID: XJ38437
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ38437%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.fr] INFO: Scrape type for XJ38437: 0
2025-12-05 17:01:46 [auto1.fr] INFO: Found listing with ID: RZ34367
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ34367%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.fr] INFO: Scrape type for RZ34367: 2
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_d3ba7eac12dfee72ddcf313ba8e90b91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d3ba7eac12dfee72ddcf313ba8e90b91.jpg not downloaded yet
2025-12-05 17:01:46 [auto1.fr] INFO: Found listing with ID: VY91068
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY91068%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [auto1.fr] INFO: Scrape type for VY91068: 2
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_2fe5366979fa8b19686a79e2bbc5b052.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_2fe5366979fa8b19686a79e2bbc5b052.jpg not downloaded yet
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d5f10>
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_93438d37bf367e84f42fb0dfc0474e91.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_93438d37bf367e84f42fb0dfc0474e91.jpg saved to cache
2025-12-05 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1cd10>
2025-12-05 17:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_c54f25d6dbedd05780053cc24454f4cc.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_c54f25d6dbedd05780053cc24454f4cc.jpg saved to cache
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: TM01350
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM01350%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for TM01350: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: UG95969
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG95969%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for UG95969: 2
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_57d3a385d40dd57a51c077dc19355902.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_57d3a385d40dd57a51c077dc19355902.jpg not downloaded yet
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_207dbf8c5ddf399bcb8fa5ed81d88c96.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: ZU06236
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU06236%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for ZU06236: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: JJ00351
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ00351%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for JJ00351: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: CD69924
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD69924%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for CD69924: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: VC89216
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC89216%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for VC89216: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: PA50527
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA50527%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for PA50527: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: ZF60208
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF60208%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for ZF60208: 2
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD60293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH21838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC94844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG68439> (referer: https://www.auto1.com/v1/car-details-view/VG68439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX19828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: MV71131
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV71131%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for MV71131: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: JZ13563
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ13563%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for JZ13563: 2
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579d890>
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_3379c84bd688718fa63e78d4d20dd657.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_3379c84bd688718fa63e78d4d20dd657.jpg saved to cache
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f3a90>
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_8d638007e9941a05f7fd1cad934af685.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8d638007e9941a05f7fd1cad934af685.jpg saved to cache
2025-12-05 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: LP64567
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP64567%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for LP64567: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: HF74477
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF74477%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for HF74477: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: HS02796
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS02796%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for HS02796: 0
2025-12-05 17:01:47 [auto1.fr] INFO: Found listing with ID: DJ25588
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ25588%27 HTTP/1.1" 200 None
2025-12-05 17:01:47 [auto1.fr] INFO: Scrape type for DJ25588: 2
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b3f10>
2025-12-05 17:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_207dbf8c5ddf399bcb8fa5ed81d88c96.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_207dbf8c5ddf399bcb8fa5ed81d88c96.jpg saved to cache
2025-12-05 17:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb with identifier: VG68439
2025-12-05 17:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb with scrape type 2
2025-12-05 17:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb with scrape type 2
2025-12-05 17:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb, identifier: VG68439
2025-12-05 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_57d3a385d40dd57a51c077dc19355902.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d3ba7eac12dfee72ddcf313ba8e90b91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_2fe5366979fa8b19686a79e2bbc5b052.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: FU20043
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU20043%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for FU20043: 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: LV50337
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV50337%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for LV50337: 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: EW89224
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW89224%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for EW89224: 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: XA71478
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA71478%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for XA71478: 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: ZM09873
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM09873%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for ZM09873: 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: AU12226
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU12226%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for AU12226: 2
2025-12-05 17:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb with identifier: VG68439
2025-12-05 17:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb with identifier: VG68439
2025-12-05 17:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 76607, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg68439', 'expiration_date': '2025-12-06t16:10:07z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '176ffda5-ef6f-55ea-b878-c36c0c0ea3cb', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 76607}
Failed validating None in schema:
False
On instance:
{'age_in_months': 59,
'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:10:07z',
'fuel_type': 'petrol',
'id': '176ffda5-ef6f-55ea-b878-c36c0c0ea3cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg68439',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 76607,
'odometer_in_km': 76607,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2020}
2025-12-05 17:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb spider: auto1.fr
2025-12-05 17:01:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 176ffda5-ef6f-55ea-b878-c36c0c0ea3cb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 76607, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg68439', 'expiration_date': '2025-12-06t16:10:07z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '176ffda5-ef6f-55ea-b878-c36c0c0ea3cb', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 76607}
Failed validating None in schema:
False
On instance:
{'age_in_months': 59,
'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:10:07z',
'fuel_type': 'petrol',
'id': '176ffda5-ef6f-55ea-b878-c36c0c0ea3cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg68439',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 76607,
'odometer_in_km': 76607,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:10:07Z',
'fuel_type': 'petrol',
'id': '176ffda5-ef6f-55ea-b878-c36c0c0ea3cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG68439',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Peugeot',
'model': '2008',
'odometer': 76607,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG68439%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Saving data for VG68439: {'auction_closing_time': 1765037407.0, 'created_time': 1763658964.332057, 'last_price_update_time': 1764954108.623342}
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG68439') HTTP/1.1" 204 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: ES24107
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES24107%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for ES24107: 0
2025-12-05 17:01:48 [auto1.fr] INFO: Found listing with ID: AM09789
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM09789%27 HTTP/1.1" 200 None
2025-12-05 17:01:48 [auto1.fr] INFO: Scrape type for AM09789: 2
2025-12-05 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH01560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a64090>
2025-12-05 17:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_57d3a385d40dd57a51c077dc19355902.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_57d3a385d40dd57a51c077dc19355902.jpg saved to cache
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e65b90>
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_d3ba7eac12dfee72ddcf313ba8e90b91.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d3ba7eac12dfee72ddcf313ba8e90b91.jpg saved to cache
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5967b90>
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_2fe5366979fa8b19686a79e2bbc5b052.jpg') HTTP/1.1" 204 0
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_2fe5366979fa8b19686a79e2bbc5b052.jpg saved to cache
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: DC22191
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC22191%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for DC22191: 1
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: DJ78229
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ78229%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for DJ78229: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: VN20500
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN20500%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for VN20500: 2
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ30898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW89332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF05185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV79309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ67118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: HG99143
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG99143%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for HG99143: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: LJ48687
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ48687%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for LJ48687: 2
2025-12-05 17:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS14045> (referer: https://www.auto1.com/v1/car-details-view/TS14045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: KV30825
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV30825%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for KV30825: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: JP35397
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP35397%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for JP35397: 2
2025-12-05 17:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: JP07741
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP07741%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for JP07741: 2
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: WP45798
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP45798%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for WP45798: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: AZ05134
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ05134%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for AZ05134: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: UH30890
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH30890%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for UH30890: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: TM68710
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM68710%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for TM68710: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: PS00346
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS00346%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for PS00346: 0
2025-12-05 17:01:49 [auto1.fr] INFO: Found listing with ID: JH50075
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH50075%27 HTTP/1.1" 200 None
2025-12-05 17:01:49 [auto1.fr] INFO: Scrape type for JH50075: 2
2025-12-05 17:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07b8ad59-729b-5667-b26f-ae0944fb45e0 with identifier: TS14045
2025-12-05 17:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07b8ad59-729b-5667-b26f-ae0944fb45e0 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07b8ad59-729b-5667-b26f-ae0944fb45e0 with scrape type 2
2025-12-05 17:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07b8ad59-729b-5667-b26f-ae0944fb45e0, identifier: TS14045
2025-12-05 17:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07b8ad59-729b-5667-b26f-ae0944fb45e0 with identifier: TS14045
2025-12-05 17:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07b8ad59-729b-5667-b26f-ae0944fb45e0 with identifier: TS14045
2025-12-05 17:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 07b8ad59-729b-5667-b26f-ae0944fb45e0 with identifier: TS14045 to the API
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS14045>
{'auction_title': '',
'c_o_2_emission_value': 35,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 158,
'expiration_date': '2025-12-06T16:45:16Z',
'fuel_type': 'hybrid',
'id': '07b8ad59-729b-5667-b26f-ae0944fb45e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS14045',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Renault',
'model': 'Captur',
'odometer': 31704,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2021}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS14045%27 HTTP/1.1" 200 None
2025-12-05 17:01:51 [auto1.fr] INFO: Saving data for TS14045: {'auction_closing_time': 1765039516.0, 'created_time': 1764842661.319921, 'last_price_update_time': 1764954111.010804}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TS14045') HTTP/1.1" 204 0
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST01655> (referer: https://www.auto1.com/v1/car-details-view/ST01655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e636a01e-919b-5cd0-b596-c41ad0374e27 with identifier: ST01655
2025-12-05 17:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e636a01e-919b-5cd0-b596-c41ad0374e27 with scrape type 2
2025-12-05 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e636a01e-919b-5cd0-b596-c41ad0374e27 with scrape type 2
2025-12-05 17:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e636a01e-919b-5cd0-b596-c41ad0374e27, identifier: ST01655
2025-12-05 17:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e636a01e-919b-5cd0-b596-c41ad0374e27 with identifier: ST01655
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e636a01e-919b-5cd0-b596-c41ad0374e27 with identifier: ST01655
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 106831, 'odometer_reading_unit': 'km', 'registration_date': '2019-08-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/st01655', 'expiration_date': '2025-12-06t16:43:27z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-avé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': 'e636a01e-919b-5cd0-b596-c41ad0374e27', 'current_year_diff': 6, 'age_in_months': 75, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 106831}
Failed validating None in schema:
False
On instance:
{'age_in_months': 75,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:43:27z',
'fuel_type': 'petrol',
'id': 'e636a01e-919b-5cd0-b596-c41ad0374e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/st01655',
'listing': 'auction',
'location': 'fr, saint-avé',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 106831,
'odometer_in_km': 106831,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2019}
2025-12-05 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e636a01e-919b-5cd0-b596-c41ad0374e27 spider: auto1.fr
2025-12-05 17:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e636a01e-919b-5cd0-b596-c41ad0374e27 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 106831, 'odometer_reading_unit': 'km', 'registration_date': '2019-08-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/st01655', 'expiration_date': '2025-12-06t16:43:27z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-avé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': 'e636a01e-919b-5cd0-b596-c41ad0374e27', 'current_year_diff': 6, 'age_in_months': 75, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 106831}
Failed validating None in schema:
False
On instance:
{'age_in_months': 75,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:43:27z',
'fuel_type': 'petrol',
'id': 'e636a01e-919b-5cd0-b596-c41ad0374e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/st01655',
'listing': 'auction',
'location': 'fr, saint-avé',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 106831,
'odometer_in_km': 106831,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:43:27Z',
'fuel_type': 'petrol',
'id': 'e636a01e-919b-5cd0-b596-c41ad0374e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST01655',
'listing': 'auction',
'location': 'FR, Saint-Avé',
'make': 'Peugeot',
'model': '2008',
'odometer': 106831,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST01655%27 HTTP/1.1" 200 None
2025-12-05 17:01:51 [auto1.fr] INFO: Saving data for ST01655: {'auction_closing_time': 1765039407.0, 'created_time': 1764842649.983996, 'last_price_update_time': 1764954111.526531}
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST01655') HTTP/1.1" 204 0
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY91068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ13563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG95969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:51 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:51 [auto1.fr] INFO: Found listing with ID: FX73161
2025-12-05 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX73161%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for FX73161: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: SL11035
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL11035%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for SL11035: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: KX08162
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX08162%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for KX08162: 2
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF35414> (referer: https://www.auto1.com/v1/car-details-view/JF35414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: ED43904
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED43904%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for ED43904: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: AZ56136
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ56136%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for AZ56136: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: XU69600
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU69600%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for XU69600: 2
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: BK59112
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK59112%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for BK59112: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: EF90048
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF90048%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for EF90048: 2
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ34367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96acd732-8e95-5b90-a914-c27852fee1ca with identifier: JF35414
2025-12-05 17:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96acd732-8e95-5b90-a914-c27852fee1ca with scrape type 2
2025-12-05 17:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96acd732-8e95-5b90-a914-c27852fee1ca with scrape type 2
2025-12-05 17:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 96acd732-8e95-5b90-a914-c27852fee1ca, identifier: JF35414
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: NJ62773
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ62773%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for NJ62773: 2
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 96acd732-8e95-5b90-a914-c27852fee1ca with identifier: JF35414
2025-12-05 17:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 96acd732-8e95-5b90-a914-c27852fee1ca with identifier: JF35414
2025-12-05 17:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 96acd732-8e95-5b90-a914-c27852fee1ca with identifier: JF35414 to the API
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF35414>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2025-12-06T16:19:30Z',
'fuel_type': 'diesel',
'id': '96acd732-8e95-5b90-a914-c27852fee1ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF35414',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 113418,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.6 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2018}
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF35414%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Saving data for JF35414: {'auction_closing_time': 1765037970.0, 'created_time': 1764349393.605166, 'last_price_update_time': 1764954112.678589}
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JF35414') HTTP/1.1" 204 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: NS06162
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS06162%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for NS06162: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: JZ86927
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ86927%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for JZ86927: 2
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC22191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM09789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH01560> (referer: https://www.auto1.com/v1/car-details-view/EH01560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: ZK49672
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK49672%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for ZK49672: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: FE03122
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE03122%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for FE03122: 2
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: BS63637
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS63637%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for BS63637: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: ZJ94391
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ94391%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for ZJ94391: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: XD59635
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD59635%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for XD59635: 2
2025-12-05 17:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF60208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: YF11400
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF11400%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for YF11400: 1
2025-12-05 17:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: YG39135
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG39135%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for YG39135: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: SW83574
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW83574%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for SW83574: 2
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: AU58821
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU58821%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for AU58821: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: FJ67193
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ67193%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for FJ67193: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: UB09014
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB09014%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for UB09014: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: TP27666
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP27666%27 HTTP/1.1" 200 None
2025-12-05 17:01:52 [auto1.fr] INFO: Scrape type for TP27666: 0
2025-12-05 17:01:52 [auto1.fr] INFO: Found listing with ID: DH13444
2025-12-05 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH13444%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for DH13444: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: DR56396
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR56396%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for DR56396: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: BM43404
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM43404%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for BM43404: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: CY92610
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY92610%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for CY92610: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: YZ70817
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ70817%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for YZ70817: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: LC61020
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC61020%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for LC61020: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: ZU45316
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU45316%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for ZU45316: 2
2025-12-05 17:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088d5ed2-4872-597c-a347-fa6095534daa with identifier: EH01560
2025-12-05 17:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088d5ed2-4872-597c-a347-fa6095534daa with scrape type 1
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 088d5ed2-4872-597c-a347-fa6095534daa
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_c5795e9352b84c9a682d116cb6f6c1d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_c5795e9352b84c9a682d116cb6f6c1d4.jpg already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_b93b48b97f6f91bdafd484cc00132076.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b93b48b97f6f91bdafd484cc00132076.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_22c9acb46bc112898ae68e4bd740b62b.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_22c9acb46bc112898ae68e4bd740b62b.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_a721697158597dcd9bc047a2d13fb1ef.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_a721697158597dcd9bc047a2d13fb1ef.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_c2f1115724e81e379699a2aa696564d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_c2f1115724e81e379699a2aa696564d5.jpg already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_b9e39b3825bec19ae6522d7a4dbe547d.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b9e39b3825bec19ae6522d7a4dbe547d.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_a74f98bba41b16c42b4c6ded645ef29d.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_a74f98bba41b16c42b4c6ded645ef29d.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_d1a687600cadf8a4c452d8c965693e9c.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_d1a687600cadf8a4c452d8c965693e9c.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_f1d3cf42bb88f3e4b4354e5867fb64ed.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_f1d3cf42bb88f3e4b4354e5867fb64ed.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_b68cda2951ea6b821f59be5b7de219c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b68cda2951ea6b821f59be5b7de219c5.jpg already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_d5ec7be9d39b5d57f8eaa57c66dc4546.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_d5ec7be9d39b5d57f8eaa57c66dc4546.png already downloaded
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9e%252F549e7b2df01b6aea6595f22cf6eb4721%252Fpa%252FEH01560_7d870a7e86a5b62ca2a55be775cece3b.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_7d870a7e86a5b62ca2a55be775cece3b.png already downloaded
2025-12-05 17:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 088d5ed2-4872-597c-a347-fa6095534daa, identifier: EH01560
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ25588/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 088d5ed2-4872-597c-a347-fa6095534daa with identifier: EH01560
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 088d5ed2-4872-597c-a347-fa6095534daa with identifier: EH01560
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142108 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
142108
2025-12-05 17:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 088d5ed2-4872-597c-a347-fa6095534daa spider: auto1.fr
2025-12-05 17:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 088d5ed2-4872-597c-a347-fa6095534daa due to rule: high_mileage_for_make.json, error: 142108 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
142108
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:31:40Z',
'fuel_type': 'diesel',
'id': '088d5ed2-4872-597c-a347-fa6095534daa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH01560',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Peugeot',
'model': '3008',
'odometer': 142108,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_c5795e9352b84c9a682d116cb6f6c1d4.jpg',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b93b48b97f6f91bdafd484cc00132076.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_22c9acb46bc112898ae68e4bd740b62b.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_a721697158597dcd9bc047a2d13fb1ef.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_c2f1115724e81e379699a2aa696564d5.jpg',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b9e39b3825bec19ae6522d7a4dbe547d.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_a74f98bba41b16c42b4c6ded645ef29d.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_d1a687600cadf8a4c452d8c965693e9c.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_f1d3cf42bb88f3e4b4354e5867fb64ed.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b68cda2951ea6b821f59be5b7de219c5.jpg',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_d5ec7be9d39b5d57f8eaa57c66dc4546.png',
'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_7d870a7e86a5b62ca2a55be775cece3b.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179168,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_c5795e9352b84c9a682d116cb6f6c1d4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b93b48b97f6f91bdafd484cc00132076.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_22c9acb46bc112898ae68e4bd740b62b.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_a721697158597dcd9bc047a2d13fb1ef.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_c2f1115724e81e379699a2aa696564d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b9e39b3825bec19ae6522d7a4dbe547d.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_a74f98bba41b16c42b4c6ded645ef29d.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_d1a687600cadf8a4c452d8c965693e9c.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_f1d3cf42bb88f3e4b4354e5867fb64ed.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182325,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_b68cda2951ea6b821f59be5b7de219c5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_10.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_d5ec7be9d39b5d57f8eaa57c66dc4546.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_088d5ed2-4872-597c-a347-fa6095534daa/088d5ed2-4872-597c-a347-fa6095534daa_image_11.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img54/9e/549e7b2df01b6aea6595f22cf6eb4721/pa/EH01560_7d870a7e86a5b62ca2a55be775cece3b.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH01560%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Saving data for EH01560: {'created_time': 1764954113.708048, 'last_price_update_time': 1764954113.708057, 'auction_closing_time': 1765038700.0}
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH01560') HTTP/1.1" 204 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: YY87820
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY87820%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for YY87820: 2
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX19828> (referer: https://www.auto1.com/v1/car-details-view/NX19828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU12226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: SM02905
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM02905%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for SM02905: 2
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: WP36394
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP36394%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for WP36394: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: EY58086
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY58086%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for EY58086: 2
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: GY93654
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY93654%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for GY93654: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: TP08361
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP08361%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for TP08361: 0
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: AK94885
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK94885%27 HTTP/1.1" 200 None
2025-12-05 17:01:53 [auto1.fr] INFO: Scrape type for AK94885: 2
2025-12-05 17:01:53 [auto1.fr] INFO: Found listing with ID: HD58941
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD58941%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [auto1.fr] INFO: Scrape type for HD58941: 0
2025-12-05 17:01:54 [auto1.fr] INFO: Found listing with ID: JL82152
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL82152%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [auto1.fr] INFO: Scrape type for JL82152: 0
2025-12-05 17:01:54 [auto1.fr] INFO: Found listing with ID: GU38993
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU38993%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [auto1.fr] INFO: Scrape type for GU38993: 0
2025-12-05 17:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 116be0b4-63b1-5039-8bfd-e285ef1e98e0 with identifier: NX19828
2025-12-05 17:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116be0b4-63b1-5039-8bfd-e285ef1e98e0 with scrape type 1
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 116be0b4-63b1-5039-8bfd-e285ef1e98e0
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_fd7af49918e48586b524bd6c18e3990f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_fd7af49918e48586b524bd6c18e3990f.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_5bb0925dc3a1ab01f63d323fafed1061.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_5bb0925dc3a1ab01f63d323fafed1061.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_73cc020ad387cb50691208e54d36dc92.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_73cc020ad387cb50691208e54d36dc92.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_9bf2c1a5173084e97f36d5b593699cdd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_9bf2c1a5173084e97f36d5b593699cdd.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_367abed9342cdad350ba7bf01d491129.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_367abed9342cdad350ba7bf01d491129.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_4bf6b6391ec2e6ff53eb200c16fda00c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_4bf6b6391ec2e6ff53eb200c16fda00c.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_0a9c1e42ac554affa3aa0532bdc35f06.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_0a9c1e42ac554affa3aa0532bdc35f06.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_baf7095f3d627815b06342a551b9fe92.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_baf7095f3d627815b06342a551b9fe92.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_ff95b0e936d6fa4a1956da5e79efc782.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_ff95b0e936d6fa4a1956da5e79efc782.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_97578455a7d3a00a4ecb92b7df86338c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_97578455a7d3a00a4ecb92b7df86338c.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_b2b58e306ae72158520ab1052678fa6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_b2b58e306ae72158520ab1052678fa6f.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_d2f0df861eab8dcdac60a9757d3cec83.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_d2f0df861eab8dcdac60a9757d3cec83.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_08f9b9b71deb188ae7db213e039a34b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_08f9b9b71deb188ae7db213e039a34b2.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_96b83a9f879cb5a3f8ca2a80c9b08eed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_96b83a9f879cb5a3f8ca2a80c9b08eed.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_54f49bbed67bff5e7773c6aa1636c465.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_54f49bbed67bff5e7773c6aa1636c465.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_3e8adbee8a22778ad4603948970d775b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_3e8adbee8a22778ad4603948970d775b.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_12b5ce92f03cb174a83cd0f5b9ae9527.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_12b5ce92f03cb174a83cd0f5b9ae9527.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_1b18c220bc71f666acbdb8f01a9b8218.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_1b18c220bc71f666acbdb8f01a9b8218.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_26ae7cbc2e7baf608c7a1d98ce6cd424.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_26ae7cbc2e7baf608c7a1d98ce6cd424.jpg already downloaded
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F06%252F26061cf704969b2510fd209237ca395d%252Fpa%252FNX19828_c46fab0eb06cc8d318e7d89d800faa7d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_c46fab0eb06cc8d318e7d89d800faa7d.jpg already downloaded
2025-12-05 17:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 116be0b4-63b1-5039-8bfd-e285ef1e98e0, identifier: NX19828
2025-12-05 17:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 116be0b4-63b1-5039-8bfd-e285ef1e98e0 with identifier: NX19828
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 116be0b4-63b1-5039-8bfd-e285ef1e98e0 with identifier: NX19828
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162949 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162949
2025-12-05 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 116be0b4-63b1-5039-8bfd-e285ef1e98e0 spider: auto1.fr
2025-12-05 17:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 116be0b4-63b1-5039-8bfd-e285ef1e98e0 due to rule: high_mileage_for_country.json, error: 162949 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
162949
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 218,
'expiration_date': '2025-12-06T16:54:15Z',
'fuel_type': 'petrol',
'id': '116be0b4-63b1-5039-8bfd-e285ef1e98e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX19828',
'listing': 'auction',
'location': 'FR',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 162949,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photo_urls': ['https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_fd7af49918e48586b524bd6c18e3990f.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_5bb0925dc3a1ab01f63d323fafed1061.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_73cc020ad387cb50691208e54d36dc92.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_9bf2c1a5173084e97f36d5b593699cdd.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_367abed9342cdad350ba7bf01d491129.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_4bf6b6391ec2e6ff53eb200c16fda00c.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_0a9c1e42ac554affa3aa0532bdc35f06.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_baf7095f3d627815b06342a551b9fe92.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_ff95b0e936d6fa4a1956da5e79efc782.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_97578455a7d3a00a4ecb92b7df86338c.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_b2b58e306ae72158520ab1052678fa6f.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_d2f0df861eab8dcdac60a9757d3cec83.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_08f9b9b71deb188ae7db213e039a34b2.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_96b83a9f879cb5a3f8ca2a80c9b08eed.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_54f49bbed67bff5e7773c6aa1636c465.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_3e8adbee8a22778ad4603948970d775b.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_12b5ce92f03cb174a83cd0f5b9ae9527.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_1b18c220bc71f666acbdb8f01a9b8218.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_26ae7cbc2e7baf608c7a1d98ce6cd424.jpg',
'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_c46fab0eb06cc8d318e7d89d800faa7d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_fd7af49918e48586b524bd6c18e3990f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_5bb0925dc3a1ab01f63d323fafed1061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_73cc020ad387cb50691208e54d36dc92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_9bf2c1a5173084e97f36d5b593699cdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_367abed9342cdad350ba7bf01d491129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_4bf6b6391ec2e6ff53eb200c16fda00c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_0a9c1e42ac554affa3aa0532bdc35f06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_baf7095f3d627815b06342a551b9fe92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_ff95b0e936d6fa4a1956da5e79efc782.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_97578455a7d3a00a4ecb92b7df86338c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_b2b58e306ae72158520ab1052678fa6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_d2f0df861eab8dcdac60a9757d3cec83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_08f9b9b71deb188ae7db213e039a34b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_96b83a9f879cb5a3f8ca2a80c9b08eed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_54f49bbed67bff5e7773c6aa1636c465.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_3e8adbee8a22778ad4603948970d775b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_12b5ce92f03cb174a83cd0f5b9ae9527.jpg',
'Width': 357},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_1b18c220bc71f666acbdb8f01a9b8218.jpg',
'Width': 393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_26ae7cbc2e7baf608c7a1d98ce6cd424.jpg',
'Width': 351},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116be0b4-63b1-5039-8bfd-e285ef1e98e0/116be0b4-63b1-5039-8bfd-e285ef1e98e0_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/06/26061cf704969b2510fd209237ca395d/pa/NX19828_c46fab0eb06cc8d318e7d89d800faa7d.jpg',
'Width': 386}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake 4Matic Sport AMG '
'Line',
'transmission': 'automatic',
'trim': '4Matic Sport AMG Line',
'year': 2016}
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX19828%27 HTTP/1.1" 200 None
2025-12-05 17:01:54 [auto1.fr] INFO: Saving data for NX19828: {'created_time': 1764954114.839341, 'last_price_update_time': 1764954114.839351, 'auction_closing_time': 1765040055.0}
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NX19828') HTTP/1.1" 204 0
2025-12-05 17:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV79309> (referer: https://www.auto1.com/v1/car-details-view/XV79309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ67118> (referer: https://www.auto1.com/v1/car-details-view/TZ67118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF05185> (referer: https://www.auto1.com/v1/car-details-view/KF05185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ48687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8442a74-861c-5926-849e-f0def5023886 with identifier: XV79309
2025-12-05 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8442a74-861c-5926-849e-f0def5023886 with scrape type 1
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e8442a74-861c-5926-849e-f0def5023886
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_b9464cd29f5d2749504fd7652a365ff2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_0f2e5f76997df26e5174a24b286aed36.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_6e52275cc37f9c24b84eb8580747154a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_200c93b2f249942fdc888c7a90403196.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_10d65dbae5516fe9b046f41a04f8b933.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_865e8c894433567208d5be7845a53d1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_2871f5f55687818b6baf1f15505e0b45.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_34fadae147124da5da80755eb3249eba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_62f8f3fb7686917f59f9715deda10afd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_0e888eb0399a7403a78b93b7becdc781.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg already downloaded
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F47%252F8d4792dcd0bec98d28c4a72e65d657de%252Fpa%252FXV79309_d725d9b32180783efcf2bd503e2f7c81.png%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png already downloaded
2025-12-05 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8442a74-861c-5926-849e-f0def5023886, identifier: XV79309
2025-12-05 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8442a74-861c-5926-849e-f0def5023886 with identifier: XV79309
2025-12-05 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8442a74-861c-5926-849e-f0def5023886 with identifier: XV79309
2025-12-05 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 17124, 'odometer_reading_unit': 'km', 'registration_date': '2022-05-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xv79309', 'expiration_date': '2025-12-06t16:13:44z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, creutzwald', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'e8442a74-861c-5926-849e-f0def5023886', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2409950}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2392676}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2426333}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59894}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66450}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55615}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68001}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2379039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71208}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39687}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 103935}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 70463}], 'current_year_diff': 3, 'age_in_months': 42, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 17124}
Failed validating None in schema:
False
On instance:
{'age_in_months': 42,
'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:13:44z',
'fuel_type': 'petrol',
'id': 'e8442a74-861c-5926-849e-f0def5023886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xv79309',
'listing': 'auction',
'location': 'fr, creutzwald',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 17124,
'odometer_in_km': 17124,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409950,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2392676,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426333,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379039,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70463,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-10',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech gt',
'transmission': 'manual',
'trim': 'gt',
'year': 2022}
2025-12-05 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e8442a74-861c-5926-849e-f0def5023886 spider: auto1.fr
2025-12-05 17:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e8442a74-861c-5926-849e-f0def5023886 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 17124, 'odometer_reading_unit': 'km', 'registration_date': '2022-05-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xv79309', 'expiration_date': '2025-12-06t16:13:44z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg', 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, creutzwald', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'e8442a74-861c-5926-849e-f0def5023886', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2409950}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2392676}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2426333}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59894}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66450}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55615}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68001}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2379039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71208}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39687}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 103935}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 70463}], 'current_year_diff': 3, 'age_in_months': 42, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 17124}
Failed validating None in schema:
False
On instance:
{'age_in_months': 42,
'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:13:44z',
'fuel_type': 'petrol',
'id': 'e8442a74-861c-5926-849e-f0def5023886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xv79309',
'listing': 'auction',
'location': 'fr, creutzwald',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 17124,
'odometer_in_km': 17124,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409950,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2392676,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426333,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379039,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70463,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-10',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech gt',
'transmission': 'manual',
'trim': 'gt',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:13:44Z',
'fuel_type': 'petrol',
'id': 'e8442a74-861c-5926-849e-f0def5023886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV79309',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Peugeot',
'model': '208',
'odometer': 17124,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg',
'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409950,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_b9464cd29f5d2749504fd7652a365ff2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2392676,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_80cedf4e4d582f06f4d96f034337ebd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426333,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0f2e5f76997df26e5174a24b286aed36.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_9bdf9a8b73d498fa7d5fb7fbec7850ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_6e52275cc37f9c24b84eb8580747154a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_200c93b2f249942fdc888c7a90403196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_10d65dbae5516fe9b046f41a04f8b933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_bac4f0f7abec4bbdfad8aca90fe3b758.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379039,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_865e8c894433567208d5be7845a53d1d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_2871f5f55687818b6baf1f15505e0b45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_34fadae147124da5da80755eb3249eba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_83405e5fd61bd0aec8e08e8f6c1ff40f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_62f8f3fb7686917f59f9715deda10afd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_ba7907e3c9c2ba39cb85f6f80dc06559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_0e888eb0399a7403a78b93b7becdc781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8442a74-861c-5926-849e-f0def5023886/e8442a74-861c-5926-849e-f0def5023886_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70463,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img8d/47/8d4792dcd0bec98d28c4a72e65d657de/pa/XV79309_d725d9b32180783efcf2bd503e2f7c81.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2022}
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV79309%27 HTTP/1.1" 200 None
2025-12-05 17:01:55 [auto1.fr] INFO: Saving data for XV79309: {'created_time': 1764954115.734058, 'last_price_update_time': 1764954115.73407, 'auction_closing_time': 1765037624.0}
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XV79309') HTTP/1.1" 204 0
2025-12-05 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b2529d1-5449-5a81-a411-a27dd4123225 with identifier: TZ67118
2025-12-05 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b2529d1-5449-5a81-a411-a27dd4123225 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b2529d1-5449-5a81-a411-a27dd4123225 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b2529d1-5449-5a81-a411-a27dd4123225, identifier: TZ67118
2025-12-05 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4703385-d8a3-57b1-bd1a-34d54aeb94b6 with identifier: KF05185
2025-12-05 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4703385-d8a3-57b1-bd1a-34d54aeb94b6 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4703385-d8a3-57b1-bd1a-34d54aeb94b6 with scrape type 2
2025-12-05 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b4703385-d8a3-57b1-bd1a-34d54aeb94b6, identifier: KF05185
2025-12-05 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b2529d1-5449-5a81-a411-a27dd4123225 with identifier: TZ67118
2025-12-05 17:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2025-12-05 17:01:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b2529d1-5449-5a81-a411-a27dd4123225 with identifier: TZ67118
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gold', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 182426, 'odometer_reading_unit': 'km', 'registration_date': '2017-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz67118', 'expiration_date': '2025-12-06t16:29:15z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, creutzwald', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '8b2529d1-5449-5a81-a411-a27dd4123225', 'current_year_diff': 8, 'age_in_months': 101, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 182426}
Failed validating None in schema:
False
On instance:
{'age_in_months': 101,
'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gold',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:29:15z',
'fuel_type': 'petrol',
'id': '8b2529d1-5449-5a81-a411-a27dd4123225',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz67118',
'listing': 'auction',
'location': 'fr, creutzwald',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 182426,
'odometer_in_km': 182426,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-26',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8b2529d1-5449-5a81-a411-a27dd4123225 spider: auto1.fr
2025-12-05 17:01:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8b2529d1-5449-5a81-a411-a27dd4123225 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gold', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 182426, 'odometer_reading_unit': 'km', 'registration_date': '2017-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz67118', 'expiration_date': '2025-12-06t16:29:15z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, creutzwald', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '8b2529d1-5449-5a81-a411-a27dd4123225', 'current_year_diff': 8, 'age_in_months': 101, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 182426}
Failed validating None in schema:
False
On instance:
{'age_in_months': 101,
'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gold',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:29:15z',
'fuel_type': 'petrol',
'id': '8b2529d1-5449-5a81-a411-a27dd4123225',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz67118',
'listing': 'auction',
'location': 'fr, creutzwald',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 182426,
'odometer_in_km': 182426,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-26',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:29:15Z',
'fuel_type': 'petrol',
'id': '8b2529d1-5449-5a81-a411-a27dd4123225',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ67118',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Peugeot',
'model': '5008',
'odometer': 182426,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-26',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ67118%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Saving data for TZ67118: {'auction_closing_time': 1765038555.0, 'created_time': 1764756465.787121, 'last_price_update_time': 1764954116.339093}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ67118') HTTP/1.1" 204 0
2025-12-05 17:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b4703385-d8a3-57b1-bd1a-34d54aeb94b6 with identifier: KF05185
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b4703385-d8a3-57b1-bd1a-34d54aeb94b6 with identifier: KF05185
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 130383, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kf05185', 'expiration_date': '2025-12-06t16:08:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'b4703385-d8a3-57b1-bd1a-34d54aeb94b6', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 130383}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:08:22z',
'fuel_type': 'petrol',
'id': 'b4703385-d8a3-57b1-bd1a-34d54aeb94b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kf05185',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 130383,
'odometer_in_km': 130383,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2017}
2025-12-05 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b4703385-d8a3-57b1-bd1a-34d54aeb94b6 spider: auto1.fr
2025-12-05 17:01:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b4703385-d8a3-57b1-bd1a-34d54aeb94b6 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 130383, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kf05185', 'expiration_date': '2025-12-06t16:08:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'b4703385-d8a3-57b1-bd1a-34d54aeb94b6', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 130383}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:08:22z',
'fuel_type': 'petrol',
'id': 'b4703385-d8a3-57b1-bd1a-34d54aeb94b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kf05185',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 130383,
'odometer_in_km': 130383,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:08:22Z',
'fuel_type': 'petrol',
'id': 'b4703385-d8a3-57b1-bd1a-34d54aeb94b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF05185',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Peugeot',
'model': '5008',
'odometer': 130383,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-27',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF05185%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Saving data for KF05185: {'auction_closing_time': 1765037302.0, 'created_time': 1762941918.309865, 'last_price_update_time': 1764954116.66547}
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF05185') HTTP/1.1" 204 0
2025-12-05 17:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ13563> (referer: https://www.auto1.com/v1/car-details-view/JZ13563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY91068> (referer: https://www.auto1.com/v1/car-details-view/VY91068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN20500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:56 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: BS47167
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS47167%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for BS47167: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: ED14527
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED14527%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for ED14527: 1
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: TG30011
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG30011%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for TG30011: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: YX79288
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX79288%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for YX79288: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: UJ35100
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ35100%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for UJ35100: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: XU50418
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU50418%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for XU50418: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: PK16721
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK16721%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for PK16721: 2
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: FY54424
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY54424%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for FY54424: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: ZG61653
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG61653%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for ZG61653: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: CD48394
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD48394%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for CD48394: 0
2025-12-05 17:01:56 [auto1.fr] INFO: Found listing with ID: JS66626
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS66626%27 HTTP/1.1" 200 None
2025-12-05 17:01:56 [auto1.fr] INFO: Scrape type for JS66626: 2
2025-12-05 17:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9fff31-ba33-52cc-b740-4eb362893281 with identifier: JZ13563
2025-12-05 17:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9fff31-ba33-52cc-b740-4eb362893281 with scrape type 2
2025-12-05 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab9fff31-ba33-52cc-b740-4eb362893281 with scrape type 2
2025-12-05 17:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab9fff31-ba33-52cc-b740-4eb362893281, identifier: JZ13563
2025-12-05 17:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed69a565-2a6f-5585-b287-7171c6f2ab93 with identifier: VY91068
2025-12-05 17:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed69a565-2a6f-5585-b287-7171c6f2ab93 with scrape type 2
2025-12-05 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed69a565-2a6f-5585-b287-7171c6f2ab93 with scrape type 2
2025-12-05 17:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ed69a565-2a6f-5585-b287-7171c6f2ab93, identifier: VY91068
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: FB57155
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB57155%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for FB57155: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: EG57202
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG57202%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for EG57202: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: RM46750
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM46750%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for RM46750: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: RM92239
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM92239%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for RM92239: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: SD31290
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD31290%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for SD31290: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: WM09273
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM09273%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for WM09273: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: ZA27562
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA27562%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for ZA27562: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: TL95977
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL95977%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for TL95977: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: TW96526
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW96526%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for TW96526: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: TZ17686
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ17686%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for TZ17686: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: GZ40091
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ40091%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for GZ40091: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: HB65468
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB65468%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for HB65468: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: US26101
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US26101%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for US26101: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: DJ46229
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ46229%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for DJ46229: 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: FG93607
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG93607%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Scrape type for FG93607: 2
2025-12-05 17:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab9fff31-ba33-52cc-b740-4eb362893281 with identifier: JZ13563
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab9fff31-ba33-52cc-b740-4eb362893281 with identifier: JZ13563
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 picasso 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 picasso', 'transmission': 'manual', 'odometer': 157687, 'odometer_reading_unit': 'km', 'registration_date': '2016-10-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jz13563', 'expiration_date': '2025-12-06t16:28:49z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': 'ab9fff31-ba33-52cc-b740-4eb362893281', 'current_year_diff': 9, 'age_in_months': 109, 'make_model': 'citroen c4 picasso', 'sanitized_make': 'citroen', 'odometer_in_km': 157687}
Failed validating None in schema:
False
On instance:
{'age_in_months': 109,
'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:28:49z',
'fuel_type': 'petrol',
'id': 'ab9fff31-ba33-52cc-b740-4eb362893281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jz13563',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'citroen',
'make_model': 'citroen c4 picasso',
'model': 'c4 picasso',
'odometer': 157687,
'odometer_in_km': 157687,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-27',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 picasso 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2016}
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ab9fff31-ba33-52cc-b740-4eb362893281 spider: auto1.fr
2025-12-05 17:01:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ab9fff31-ba33-52cc-b740-4eb362893281 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 picasso 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 picasso', 'transmission': 'manual', 'odometer': 157687, 'odometer_reading_unit': 'km', 'registration_date': '2016-10-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jz13563', 'expiration_date': '2025-12-06t16:28:49z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': 'ab9fff31-ba33-52cc-b740-4eb362893281', 'current_year_diff': 9, 'age_in_months': 109, 'make_model': 'citroen c4 picasso', 'sanitized_make': 'citroen', 'odometer_in_km': 157687}
Failed validating None in schema:
False
On instance:
{'age_in_months': 109,
'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:28:49z',
'fuel_type': 'petrol',
'id': 'ab9fff31-ba33-52cc-b740-4eb362893281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jz13563',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'citroen',
'make_model': 'citroen c4 picasso',
'model': 'c4 picasso',
'odometer': 157687,
'odometer_in_km': 157687,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-27',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 picasso 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:28:49Z',
'fuel_type': 'petrol',
'id': 'ab9fff31-ba33-52cc-b740-4eb362893281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ13563',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 157687,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2016}
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ13563%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Saving data for JZ13563: {'auction_closing_time': 1765038529.0, 'created_time': 1764090886.693538, 'last_price_update_time': 1764954117.628043}
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JZ13563') HTTP/1.1" 204 0
2025-12-05 17:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ed69a565-2a6f-5585-b287-7171c6f2ab93 with identifier: VY91068
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ed69a565-2a6f-5585-b287-7171c6f2ab93 with identifier: VY91068
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186037 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
186037
2025-12-05 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ed69a565-2a6f-5585-b287-7171c6f2ab93 spider: auto1.fr
2025-12-05 17:01:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ed69a565-2a6f-5585-b287-7171c6f2ab93 due to rule: high_mileage_for_country.json, error: 186037 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
186037
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': 'Taxi',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:59:53Z',
'fuel_type': 'diesel',
'id': 'ed69a565-2a6f-5585-b287-7171c6f2ab93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY91068',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 186037,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-23',
'seats_number': 7,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2023}
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY91068%27 HTTP/1.1" 200 None
2025-12-05 17:01:57 [auto1.fr] INFO: Saving data for VY91068: {'auction_closing_time': 1765040393.0, 'created_time': 1764748834.900545, 'last_price_update_time': 1764954117.972466}
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY91068') HTTP/1.1" 204 0
2025-12-05 17:01:57 [auto1.fr] INFO: Found listing with ID: WD47260
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD47260%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for WD47260: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: DR66532
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR66532%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for DR66532: 2
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ86927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ34367> (referer: https://www.auto1.com/v1/car-details-view/RZ34367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF90048/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ62773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: MW88232
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW88232%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for MW88232: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: MG15929
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG15929%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for MG15929: 2
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: AD81593
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD81593%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for AD81593: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: DA67457
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA67457%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for DA67457: 1
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: ZW66039
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW66039%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for ZW66039: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: LR01465
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR01465%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for LR01465: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: PV87229
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV87229%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for PV87229: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: RR16791
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR16791%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for RR16791: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: DJ44324
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ44324%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for DJ44324: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: PF90077
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF90077%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for PF90077: 0
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: LY81373
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY81373%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for LY81373: 2
2025-12-05 17:01:58 [auto1.fr] INFO: Found listing with ID: SW33356
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW33356%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Scrape type for SW33356: 0
2025-12-05 17:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a51a658-b5c9-5110-b661-4248f219e788 with identifier: RZ34367
2025-12-05 17:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a51a658-b5c9-5110-b661-4248f219e788 with scrape type 2
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a51a658-b5c9-5110-b661-4248f219e788 with scrape type 2
2025-12-05 17:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a51a658-b5c9-5110-b661-4248f219e788, identifier: RZ34367
2025-12-05 17:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a51a658-b5c9-5110-b661-4248f219e788 with identifier: RZ34367
2025-12-05 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a51a658-b5c9-5110-b661-4248f219e788 with identifier: RZ34367
2025-12-05 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
2025-12-05 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7a51a658-b5c9-5110-b661-4248f219e788 spider: auto1.fr
2025-12-05 17:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7a51a658-b5c9-5110-b661-4248f219e788 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.3L',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:44:32Z',
'fuel_type': 'diesel',
'id': '7a51a658-b5c9-5110-b661-4248f219e788',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ34367',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Master',
'odometer': 120466,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-18',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Master 2.3 dCi Energy L2H2 3,5 Grand Confort',
'transmission': 'automatic',
'trim': 'L2H2 3,5 Grand Confort',
'year': 2018}
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ34367%27 HTTP/1.1" 200 None
2025-12-05 17:01:58 [auto1.fr] INFO: Saving data for RZ34367: {'auction_closing_time': 1765039472.0, 'created_time': 1764842778.4674, 'last_price_update_time': 1764954118.603926}
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ34367') HTTP/1.1" 204 0
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD59635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU45316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM09789> (referer: https://www.auto1.com/v1/car-details-view/AM09789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY87820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5c3c66-1533-5f82-9325-80f17022571c with identifier: AM09789
2025-12-05 17:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5c3c66-1533-5f82-9325-80f17022571c with scrape type 2
2025-12-05 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5c3c66-1533-5f82-9325-80f17022571c with scrape type 2
2025-12-05 17:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a5c3c66-1533-5f82-9325-80f17022571c, identifier: AM09789
2025-12-05 17:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a5c3c66-1533-5f82-9325-80f17022571c with identifier: AM09789
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a5c3c66-1533-5f82-9325-80f17022571c with identifier: AM09789
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 95718, 'odometer_reading_unit': 'km', 'registration_date': '2018-11-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/am09789', 'expiration_date': '2025-12-06t16:10:43z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 1', 'c_o_2_emission_value': 114, 'id': '4a5c3c66-1533-5f82-9325-80f17022571c', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 95718}
Failed validating None in schema:
False
On instance:
{'age_in_months': 84,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 1',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:10:43z',
'fuel_type': 'petrol',
'id': '4a5c3c66-1533-5f82-9325-80f17022571c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/am09789',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 95718,
'odometer_in_km': 95718,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-07',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2018}
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4a5c3c66-1533-5f82-9325-80f17022571c spider: auto1.fr
2025-12-05 17:01:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a5c3c66-1533-5f82-9325-80f17022571c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 95718, 'odometer_reading_unit': 'km', 'registration_date': '2018-11-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/am09789', 'expiration_date': '2025-12-06t16:10:43z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 1', 'c_o_2_emission_value': 114, 'id': '4a5c3c66-1533-5f82-9325-80f17022571c', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 95718}
Failed validating None in schema:
False
On instance:
{'age_in_months': 84,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 1',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:10:43z',
'fuel_type': 'petrol',
'id': '4a5c3c66-1533-5f82-9325-80f17022571c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/am09789',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 95718,
'odometer_in_km': 95718,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-07',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 1',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:10:43Z',
'fuel_type': 'petrol',
'id': '4a5c3c66-1533-5f82-9325-80f17022571c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM09789',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 95718,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM09789%27 HTTP/1.1" 200 None
2025-12-05 17:01:59 [auto1.fr] INFO: Saving data for AM09789: {'auction_closing_time': 1765037443.0, 'created_time': 1764842698.161961, 'last_price_update_time': 1764954119.292765}
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AM09789') HTTP/1.1" 204 0
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY58086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK94885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ25588> (referer: https://www.auto1.com/v1/car-details-view/DJ25588/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e32e1e-3a55-525c-a5f5-f44a1ac0a413 with identifier: DJ25588
2025-12-05 17:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e32e1e-3a55-525c-a5f5-f44a1ac0a413 with scrape type 2
2025-12-05 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98e32e1e-3a55-525c-a5f5-f44a1ac0a413 with scrape type 2
2025-12-05 17:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98e32e1e-3a55-525c-a5f5-f44a1ac0a413, identifier: DJ25588
2025-12-05 17:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98e32e1e-3a55-525c-a5f5-f44a1ac0a413 with identifier: DJ25588
2025-12-05 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98e32e1e-3a55-525c-a5f5-f44a1ac0a413 with identifier: DJ25588
2025-12-05 17:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98e32e1e-3a55-525c-a5f5-f44a1ac0a413 with identifier: DJ25588 to the API
2025-12-05 17:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ25588>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2025-12-06T16:48:34Z',
'fuel_type': 'petrol',
'id': '98e32e1e-3a55-525c-a5f5-f44a1ac0a413',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ25588',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Opel',
'model': 'Corsa',
'odometer': 91296,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2016}
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ25588%27 HTTP/1.1" 200 None
2025-12-05 17:02:00 [auto1.fr] INFO: Saving data for DJ25588: {'auction_closing_time': 1765039714.0, 'created_time': 1764842758.310894, 'last_price_update_time': 1764954120.730121}
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ25588') HTTP/1.1" 204 0
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR66532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM02905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF60208> (referer: https://www.auto1.com/v1/car-details-view/ZF60208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC22191> (referer: https://www.auto1.com/v1/car-details-view/DC22191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ48687> (referer: https://www.auto1.com/v1/car-details-view/LJ48687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU12226> (referer: https://www.auto1.com/v1/car-details-view/AU12226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36be8a07-3ae2-5888-9326-940850bfb6fb with identifier: ZF60208
2025-12-05 17:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36be8a07-3ae2-5888-9326-940850bfb6fb with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36be8a07-3ae2-5888-9326-940850bfb6fb with scrape type 2
2025-12-05 17:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36be8a07-3ae2-5888-9326-940850bfb6fb, identifier: ZF60208
2025-12-05 17:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36be8a07-3ae2-5888-9326-940850bfb6fb with identifier: ZF60208
2025-12-05 17:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36be8a07-3ae2-5888-9326-940850bfb6fb with identifier: ZF60208
2025-12-05 17:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36be8a07-3ae2-5888-9326-940850bfb6fb with identifier: ZF60208 to the API
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF60208>
{'auction_title': '',
'c_o_2_emission_value': 203,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 340,
'expiration_date': '2025-12-06T16:47:58Z',
'fuel_type': 'petrol',
'id': '36be8a07-3ae2-5888-9326-940850bfb6fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF60208',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Audi',
'model': 'Q8',
'odometer': 123700,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q8 55 TFSI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2019}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF60208%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [auto1.fr] INFO: Saving data for ZF60208: {'auction_closing_time': 1765039678.0, 'created_time': 1764436043.025802, 'last_price_update_time': 1764954121.30576}
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZF60208') HTTP/1.1" 204 0
2025-12-05 17:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd with identifier: DC22191
2025-12-05 17:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd with scrape type 1
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_50dd1811ff600d24efa9afd85d85ad9d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_50dd1811ff600d24efa9afd85d85ad9d.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_b2149b6296bb0d8f4b29de3ef06c0bdd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b2149b6296bb0d8f4b29de3ef06c0bdd.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_d68e6f9f706634611a4098ad88606d3d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_d68e6f9f706634611a4098ad88606d3d.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_2f196ecb762b96cf14326d8706a2a7f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_2f196ecb762b96cf14326d8706a2a7f3.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_8e1ca187768bddb526977bb27897e09e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_8e1ca187768bddb526977bb27897e09e.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_7952af6b3f297751a9553e1f7825010f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_7952af6b3f297751a9553e1f7825010f.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_9f9d86a3ae1201814cadff7318fb8cbf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_9f9d86a3ae1201814cadff7318fb8cbf.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_40dc058e71ca46895d31d02d7652b13d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_40dc058e71ca46895d31d02d7652b13d.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_1712ef1f01f320dc07b724ea4d2b3221.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_1712ef1f01f320dc07b724ea4d2b3221.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_b954715e460344cd2746ad30a04d3887.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b954715e460344cd2746ad30a04d3887.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_219a98d764a30c48de44febd9882df09.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_219a98d764a30c48de44febd9882df09.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_ad0af3efbbdde40091aae8b017089456.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_ad0af3efbbdde40091aae8b017089456.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_a3d0e9d479b0a60eb642ef0aaa85d26e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_a3d0e9d479b0a60eb642ef0aaa85d26e.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_198372c2299a944e8288c159126fdcd4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_198372c2299a944e8288c159126fdcd4.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_b9ae63c857b721b78c4271ecf2f924b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b9ae63c857b721b78c4271ecf2f924b7.jpg already downloaded
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fbc%252F59bccd2ce7c58c0ecf4e0dde14a27e22%252Fpa%252FDC22191_1e41ac2514e9ce7e6a7c17da9a23d4bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_1e41ac2514e9ce7e6a7c17da9a23d4bb.jpg already downloaded
2025-12-05 17:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd, identifier: DC22191
2025-12-05 17:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc with identifier: LJ48687
2025-12-05 17:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc with scrape type 2
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc with scrape type 2
2025-12-05 17:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc, identifier: LJ48687
2025-12-05 17:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a3b76d-841e-5ab9-b761-c1981fac34cb with identifier: AU12226
2025-12-05 17:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a3b76d-841e-5ab9-b761-c1981fac34cb with scrape type 2
2025-12-05 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a3b76d-841e-5ab9-b761-c1981fac34cb with scrape type 2
2025-12-05 17:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 54a3b76d-841e-5ab9-b761-c1981fac34cb, identifier: AU12226
2025-12-05 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd with identifier: DC22191
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd with identifier: DC22191
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183639 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
183639
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd spider: auto1.fr
2025-12-05 17:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd due to rule: high_mileage_for_country.json, error: 183639 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
183639
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:29:44Z',
'fuel_type': 'diesel',
'id': 'fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC22191',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 183639,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_50dd1811ff600d24efa9afd85d85ad9d.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b2149b6296bb0d8f4b29de3ef06c0bdd.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_d68e6f9f706634611a4098ad88606d3d.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_2f196ecb762b96cf14326d8706a2a7f3.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_8e1ca187768bddb526977bb27897e09e.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_7952af6b3f297751a9553e1f7825010f.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_9f9d86a3ae1201814cadff7318fb8cbf.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_40dc058e71ca46895d31d02d7652b13d.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_1712ef1f01f320dc07b724ea4d2b3221.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b954715e460344cd2746ad30a04d3887.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_219a98d764a30c48de44febd9882df09.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_ad0af3efbbdde40091aae8b017089456.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_a3d0e9d479b0a60eb642ef0aaa85d26e.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_198372c2299a944e8288c159126fdcd4.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b9ae63c857b721b78c4271ecf2f924b7.jpg',
'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_1e41ac2514e9ce7e6a7c17da9a23d4bb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_50dd1811ff600d24efa9afd85d85ad9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2940365,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b2149b6296bb0d8f4b29de3ef06c0bdd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_d68e6f9f706634611a4098ad88606d3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_2f196ecb762b96cf14326d8706a2a7f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_8e1ca187768bddb526977bb27897e09e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_7952af6b3f297751a9553e1f7825010f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2506879,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_9f9d86a3ae1201814cadff7318fb8cbf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2672704,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_40dc058e71ca46895d31d02d7652b13d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_1712ef1f01f320dc07b724ea4d2b3221.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b954715e460344cd2746ad30a04d3887.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_219a98d764a30c48de44febd9882df09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_ad0af3efbbdde40091aae8b017089456.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_a3d0e9d479b0a60eb642ef0aaa85d26e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_198372c2299a944e8288c159126fdcd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_b9ae63c857b721b78c4271ecf2f924b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd/fb100bdc-8d8f-5220-a37a-b3fbc7d13dcd_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/bc/59bccd2ce7c58c0ecf4e0dde14a27e22/pa/DC22191_1e41ac2514e9ce7e6a7c17da9a23d4bb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2016}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC22191%27 HTTP/1.1" 200 None
2025-12-05 17:02:02 [auto1.fr] INFO: Saving data for DC22191: {'created_time': 1764954122.230957, 'last_price_update_time': 1764954122.230972, 'auction_closing_time': 1765038584.0}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC22191') HTTP/1.1" 204 0
2025-12-05 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc with identifier: LJ48687
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc with identifier: LJ48687
2025-12-05 17:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1c7f0fe4-7b9e-57d2-87e6-495247a94bdc with identifier: LJ48687 to the API
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ48687>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': 'Taxi',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2025-12-06T16:20:41Z',
'fuel_type': 'hybrid',
'id': '1c7f0fe4-7b9e-57d2-87e6-495247a94bdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ48687',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Peugeot',
'model': '3008',
'odometer': 122170,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
'transmission': 'automatic',
'trim': 'GT Pack',
'year': 2021}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ48687%27 HTTP/1.1" 200 None
2025-12-05 17:02:02 [auto1.fr] INFO: Saving data for LJ48687: {'auction_closing_time': 1765038041.0, 'created_time': 1764842752.969514, 'last_price_update_time': 1764954122.570326}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LJ48687') HTTP/1.1" 204 0
2025-12-05 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 54a3b76d-841e-5ab9-b761-c1981fac34cb with identifier: AU12226
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 54a3b76d-841e-5ab9-b761-c1981fac34cb with identifier: AU12226
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152214 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152214
2025-12-05 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 54a3b76d-841e-5ab9-b761-c1981fac34cb spider: auto1.fr
2025-12-05 17:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 54a3b76d-841e-5ab9-b761-c1981fac34cb due to rule: high_mileage_for_country.json, error: 152214 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152214
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:06:22Z',
'fuel_type': 'diesel',
'id': '54a3b76d-841e-5ab9-b761-c1981fac34cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU12226',
'listing': 'auction',
'location': 'FR, Caudan',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 152214,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Confortline Business BlueMotion',
'transmission': 'automatic',
'trim': 'Confortline Business BlueMotion',
'year': 2019}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU12226%27 HTTP/1.1" 200 None
2025-12-05 17:02:02 [auto1.fr] INFO: Saving data for AU12226: {'auction_closing_time': 1765037182.0, 'created_time': 1764842626.905286, 'last_price_update_time': 1764954122.792512}
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU12226') HTTP/1.1" 204 0
2025-12-05 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG93607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN20500> (referer: https://www.auto1.com/v1/car-details-view/VN20500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceeffd8c-0219-5132-83c7-9ad30dcaf4d2 with identifier: VN20500
2025-12-05 17:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceeffd8c-0219-5132-83c7-9ad30dcaf4d2 with scrape type 2
2025-12-05 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceeffd8c-0219-5132-83c7-9ad30dcaf4d2 with scrape type 2
2025-12-05 17:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ceeffd8c-0219-5132-83c7-9ad30dcaf4d2, identifier: VN20500
2025-12-05 17:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ceeffd8c-0219-5132-83c7-9ad30dcaf4d2 with identifier: VN20500
2025-12-05 17:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ceeffd8c-0219-5132-83c7-9ad30dcaf4d2 with identifier: VN20500
2025-12-05 17:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ceeffd8c-0219-5132-83c7-9ad30dcaf4d2 with identifier: VN20500 to the API
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN20500>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:19:01Z',
'fuel_type': 'diesel',
'id': 'ceeffd8c-0219-5132-83c7-9ad30dcaf4d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN20500',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '2008',
'odometer': 119459,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN20500%27 HTTP/1.1" 200 None
2025-12-05 17:02:03 [auto1.fr] INFO: Saving data for VN20500: {'auction_closing_time': 1765037941.0, 'created_time': 1764756407.317111, 'last_price_update_time': 1764954123.33306}
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN20500') HTTP/1.1" 204 0
2025-12-05 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS66626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ62773> (referer: https://www.auto1.com/v1/car-details-view/NJ62773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY87820> (referer: https://www.auto1.com/v1/car-details-view/YY87820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ86927> (referer: https://www.auto1.com/v1/car-details-view/JZ86927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b81f866-deae-50b7-9ce9-53e7eb69777a with identifier: NJ62773
2025-12-05 17:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b81f866-deae-50b7-9ce9-53e7eb69777a with scrape type 2
2025-12-05 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b81f866-deae-50b7-9ce9-53e7eb69777a with scrape type 2
2025-12-05 17:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9b81f866-deae-50b7-9ce9-53e7eb69777a, identifier: NJ62773
2025-12-05 17:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9b81f866-deae-50b7-9ce9-53e7eb69777a with identifier: NJ62773
2025-12-05 17:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9b81f866-deae-50b7-9ce9-53e7eb69777a with identifier: NJ62773
2025-12-05 17:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173966 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173966
2025-12-05 17:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9b81f866-deae-50b7-9ce9-53e7eb69777a spider: auto1.fr
2025-12-05 17:02:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9b81f866-deae-50b7-9ce9-53e7eb69777a due to rule: high_mileage_for_country.json, error: 173966 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173966
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:06:58Z',
'fuel_type': 'diesel',
'id': '9b81f866-deae-50b7-9ce9-53e7eb69777a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ62773',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 173966,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2017}
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ62773%27 HTTP/1.1" 200 None
2025-12-05 17:02:03 [auto1.fr] INFO: Saving data for NJ62773: {'auction_closing_time': 1765037218.0, 'created_time': 1764756121.857618, 'last_price_update_time': 1764954123.98605}
2025-12-05 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NJ62773') HTTP/1.1" 204 0
2025-12-05 17:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b68713-541f-5e6d-86c6-cf55baf8e6f9 with identifier: YY87820
2025-12-05 17:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b68713-541f-5e6d-86c6-cf55baf8e6f9 with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42b68713-541f-5e6d-86c6-cf55baf8e6f9 with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 42b68713-541f-5e6d-86c6-cf55baf8e6f9, identifier: YY87820
2025-12-05 17:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 191bbbea-80fd-5a6b-9045-56dc82fb4b51 with identifier: JZ86927
2025-12-05 17:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 191bbbea-80fd-5a6b-9045-56dc82fb4b51 with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 191bbbea-80fd-5a6b-9045-56dc82fb4b51 with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 191bbbea-80fd-5a6b-9045-56dc82fb4b51, identifier: JZ86927
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF90048> (referer: https://www.auto1.com/v1/car-details-view/EF90048/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 42b68713-541f-5e6d-86c6-cf55baf8e6f9 with identifier: YY87820
2025-12-05 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 42b68713-541f-5e6d-86c6-cf55baf8e6f9 with identifier: YY87820
2025-12-05 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 74516, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy87820', 'expiration_date': '2025-12-06t16:37:35z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'montévrain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '42b68713-541f-5e6d-86c6-cf55baf8e6f9', 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 74516}
Failed validating None in schema:
False
On instance:
{'age_in_months': 83,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:37:35z',
'fuel_type': 'petrol',
'id': '42b68713-541f-5e6d-86c6-cf55baf8e6f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy87820',
'listing': 'auction',
'location': 'montévrain',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 74516,
'odometer_in_km': 74516,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-20',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2018}
2025-12-05 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 42b68713-541f-5e6d-86c6-cf55baf8e6f9 spider: auto1.fr
2025-12-05 17:02:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 42b68713-541f-5e6d-86c6-cf55baf8e6f9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 74516, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy87820', 'expiration_date': '2025-12-06t16:37:35z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'montévrain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '42b68713-541f-5e6d-86c6-cf55baf8e6f9', 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 74516}
Failed validating None in schema:
False
On instance:
{'age_in_months': 83,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:37:35z',
'fuel_type': 'petrol',
'id': '42b68713-541f-5e6d-86c6-cf55baf8e6f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy87820',
'listing': 'auction',
'location': 'montévrain',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 74516,
'odometer_in_km': 74516,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-20',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:37:35Z',
'fuel_type': 'petrol',
'id': '42b68713-541f-5e6d-86c6-cf55baf8e6f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY87820',
'listing': 'auction',
'location': 'Montévrain',
'make': 'Citroen',
'model': 'C3',
'odometer': 74516,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY87820%27 HTTP/1.1" 200 None
2025-12-05 17:02:04 [auto1.fr] INFO: Saving data for YY87820: {'auction_closing_time': 1765039055.0, 'created_time': 1764309791.071836, 'last_price_update_time': 1764954124.399251}
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY87820') HTTP/1.1" 204 0
2025-12-05 17:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 191bbbea-80fd-5a6b-9045-56dc82fb4b51 with identifier: JZ86927
2025-12-05 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 191bbbea-80fd-5a6b-9045-56dc82fb4b51 with identifier: JZ86927
2025-12-05 17:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 191bbbea-80fd-5a6b-9045-56dc82fb4b51 with identifier: JZ86927 to the API
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ86927>
{'auction_title': '',
'c_o_2_emission_value': 42,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 245,
'expiration_date': '2025-12-06T16:42:47Z',
'fuel_type': 'hybrid',
'id': '191bbbea-80fd-5a6b-9045-56dc82fb4b51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ86927',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 91518,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line Exclusive',
'transmission': 'automatic',
'trim': 'R-Line Exclusive',
'year': 2021}
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ86927%27 HTTP/1.1" 200 None
2025-12-05 17:02:04 [auto1.fr] INFO: Saving data for JZ86927: {'auction_closing_time': 1765039367.0, 'created_time': 1764756038.502588, 'last_price_update_time': 1764954124.77748}
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JZ86927') HTTP/1.1" 204 0
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK94885> (referer: https://www.auto1.com/v1/car-details-view/AK94885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU45316> (referer: https://www.auto1.com/v1/car-details-view/ZU45316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c508ad6f-4a99-5d93-ae23-4c9c86025371 with identifier: EF90048
2025-12-05 17:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c508ad6f-4a99-5d93-ae23-4c9c86025371 with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c508ad6f-4a99-5d93-ae23-4c9c86025371 with scrape type 2
2025-12-05 17:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c508ad6f-4a99-5d93-ae23-4c9c86025371, identifier: EF90048
2025-12-05 17:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c508ad6f-4a99-5d93-ae23-4c9c86025371 with identifier: EF90048
2025-12-05 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c508ad6f-4a99-5d93-ae23-4c9c86025371 with identifier: EF90048
2025-12-05 17:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c508ad6f-4a99-5d93-ae23-4c9c86025371 with identifier: EF90048 to the API
2025-12-05 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF90048>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:30:56Z',
'fuel_type': 'diesel',
'id': 'c508ad6f-4a99-5d93-ae23-4c9c86025371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF90048',
'listing': 'auction',
'location': 'FR, Sens',
'make': 'Volvo',
'model': 'XC90',
'odometer': 125371,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-19',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 D4 R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2018}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF90048%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [auto1.fr] INFO: Saving data for EF90048: {'auction_closing_time': 1765038656.0, 'created_time': 1764756179.648675, 'last_price_update_time': 1764954125.20764}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF90048') HTTP/1.1" 204 0
2025-12-05 17:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93a645d1-ac89-581d-b70e-f2178b5aa631 with identifier: AK94885
2025-12-05 17:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93a645d1-ac89-581d-b70e-f2178b5aa631 with scrape type 2
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93a645d1-ac89-581d-b70e-f2178b5aa631 with scrape type 2
2025-12-05 17:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93a645d1-ac89-581d-b70e-f2178b5aa631, identifier: AK94885
2025-12-05 17:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41ad648-7003-5f2a-adfb-af4aa2ec1152 with identifier: ZU45316
2025-12-05 17:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41ad648-7003-5f2a-adfb-af4aa2ec1152 with scrape type 2
2025-12-05 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f41ad648-7003-5f2a-adfb-af4aa2ec1152 with scrape type 2
2025-12-05 17:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f41ad648-7003-5f2a-adfb-af4aa2ec1152, identifier: ZU45316
2025-12-05 17:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93a645d1-ac89-581d-b70e-f2178b5aa631 with identifier: AK94885
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93a645d1-ac89-581d-b70e-f2178b5aa631 with identifier: AK94885
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171037 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171037
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 93a645d1-ac89-581d-b70e-f2178b5aa631 spider: auto1.fr
2025-12-05 17:02:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 93a645d1-ac89-581d-b70e-f2178b5aa631 due to rule: high_mileage_for_country.json, error: 171037 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171037
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2025-12-06T16:22:17Z',
'fuel_type': 'diesel',
'id': '93a645d1-ac89-581d-b70e-f2178b5aa631',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK94885',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 171037,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan X-Trail 2.0 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2017}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK94885%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [auto1.fr] INFO: Saving data for AK94885: {'auction_closing_time': 1765038137.0, 'created_time': 1764842788.492377, 'last_price_update_time': 1764954125.614951}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK94885') HTTP/1.1" 204 0
2025-12-05 17:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f41ad648-7003-5f2a-adfb-af4aa2ec1152 with identifier: ZU45316
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f41ad648-7003-5f2a-adfb-af4aa2ec1152 with identifier: ZU45316
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168560 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
168560
2025-12-05 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f41ad648-7003-5f2a-adfb-af4aa2ec1152 spider: auto1.fr
2025-12-05 17:02:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f41ad648-7003-5f2a-adfb-af4aa2ec1152 due to rule: high_mileage_for_country.json, error: 168560 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
168560
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:39:33Z',
'fuel_type': 'diesel',
'id': 'f41ad648-7003-5f2a-adfb-af4aa2ec1152',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU45316',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Peugeot',
'model': '2008',
'odometer': 168560,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure Business',
'transmission': 'manual',
'trim': 'Allure Business',
'year': 2021}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU45316%27 HTTP/1.1" 200 None
2025-12-05 17:02:05 [auto1.fr] INFO: Saving data for ZU45316: {'auction_closing_time': 1765039173.0, 'created_time': 1764842777.1339, 'last_price_update_time': 1764954125.872901}
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZU45316') HTTP/1.1" 204 0
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA67457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG15929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD59635> (referer: https://www.auto1.com/v1/car-details-view/XD59635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY58086> (referer: https://www.auto1.com/v1/car-details-view/EY58086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c57930cb-73d5-58e0-a29d-8a44b2603ba6 with identifier: XD59635
2025-12-05 17:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c57930cb-73d5-58e0-a29d-8a44b2603ba6 with scrape type 2
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c57930cb-73d5-58e0-a29d-8a44b2603ba6 with scrape type 2
2025-12-05 17:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c57930cb-73d5-58e0-a29d-8a44b2603ba6, identifier: XD59635
2025-12-05 17:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c57930cb-73d5-58e0-a29d-8a44b2603ba6 with identifier: XD59635
2025-12-05 17:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c57930cb-73d5-58e0-a29d-8a44b2603ba6 with identifier: XD59635
2025-12-05 17:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163893 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163893
2025-12-05 17:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c57930cb-73d5-58e0-a29d-8a44b2603ba6 spider: auto1.fr
2025-12-05 17:02:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c57930cb-73d5-58e0-a29d-8a44b2603ba6 due to rule: high_mileage_for_country.json, error: 163893 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163893
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:03:47Z',
'fuel_type': 'diesel',
'id': 'c57930cb-73d5-58e0-a29d-8a44b2603ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD59635',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Peugeot',
'model': '5008',
'odometer': 163893,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-16',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD59635%27 HTTP/1.1" 200 None
2025-12-05 17:02:06 [auto1.fr] INFO: Saving data for XD59635: {'auction_closing_time': 1765037027.0, 'created_time': 1764436186.006977, 'last_price_update_time': 1764954126.308969}
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XD59635') HTTP/1.1" 204 0
2025-12-05 17:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e344092-35fc-5bad-9efa-a97ab023ed4e with identifier: EY58086
2025-12-05 17:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e344092-35fc-5bad-9efa-a97ab023ed4e with scrape type 2
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e344092-35fc-5bad-9efa-a97ab023ed4e with scrape type 2
2025-12-05 17:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e344092-35fc-5bad-9efa-a97ab023ed4e, identifier: EY58086
2025-12-05 17:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e344092-35fc-5bad-9efa-a97ab023ed4e with identifier: EY58086
2025-12-05 17:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e344092-35fc-5bad-9efa-a97ab023ed4e with identifier: EY58086
2025-12-05 17:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e344092-35fc-5bad-9efa-a97ab023ed4e with identifier: EY58086 to the API
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY58086>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2025-12-06T16:50:47Z',
'fuel_type': 'petrol',
'id': '9e344092-35fc-5bad-9efa-a97ab023ed4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY58086',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'MINI',
'model': 'MINI',
'odometer': 87778,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-06',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY58086%27 HTTP/1.1" 200 None
2025-12-05 17:02:06 [auto1.fr] INFO: Saving data for EY58086: {'auction_closing_time': 1765039847.0, 'created_time': 1764223468.044176, 'last_price_update_time': 1764954126.734571}
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EY58086') HTTP/1.1" 204 0
2025-12-05 17:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM02905> (referer: https://www.auto1.com/v1/car-details-view/SM02905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK16721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0366700-2a9a-52bc-8429-20ad2924d768 with identifier: SM02905
2025-12-05 17:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0366700-2a9a-52bc-8429-20ad2924d768 with scrape type 2
2025-12-05 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0366700-2a9a-52bc-8429-20ad2924d768 with scrape type 2
2025-12-05 17:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0366700-2a9a-52bc-8429-20ad2924d768, identifier: SM02905
2025-12-05 17:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0366700-2a9a-52bc-8429-20ad2924d768 with identifier: SM02905
2025-12-05 17:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0366700-2a9a-52bc-8429-20ad2924d768 with identifier: SM02905
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b0366700-2a9a-52bc-8429-20ad2924d768 spider: auto1.fr
2025-12-05 17:02:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b0366700-2a9a-52bc-8429-20ad2924d768 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2025-12-06T16:53:24Z',
'fuel_type': 'diesel',
'id': 'b0366700-2a9a-52bc-8429-20ad2924d768',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM02905',
'listing': 'auction',
'location': 'FR, Saint-Avé',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 97850,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
'transmission': 'manual',
'trim': 'Active L1',
'year': 2019}
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM02905%27 HTTP/1.1" 200 None
2025-12-05 17:02:07 [auto1.fr] INFO: Saving data for SM02905: {'auction_closing_time': 1765040004.0, 'created_time': 1764842536.141639, 'last_price_update_time': 1764954127.153289}
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM02905') HTTP/1.1" 204 0
2025-12-05 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED14527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY81373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG93607> (referer: https://www.auto1.com/v1/car-details-view/FG93607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR66532> (referer: https://www.auto1.com/v1/car-details-view/DR66532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS66626> (referer: https://www.auto1.com/v1/car-details-view/JS66626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:07 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:02:07 [auto1.fr] INFO: Found listing with ID: MN69075
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN69075%27 HTTP/1.1" 200 None
2025-12-05 17:02:07 [auto1.fr] INFO: Scrape type for MN69075: 1
2025-12-05 17:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b65db0-46f3-5295-9992-4821185fef0d with identifier: FG93607
2025-12-05 17:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b65db0-46f3-5295-9992-4821185fef0d with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b65db0-46f3-5295-9992-4821185fef0d with scrape type 2
2025-12-05 17:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57b65db0-46f3-5295-9992-4821185fef0d, identifier: FG93607
2025-12-05 17:02:07 [auto1.fr] INFO: Found listing with ID: UD35808
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD35808%27 HTTP/1.1" 200 None
2025-12-05 17:02:07 [auto1.fr] INFO: Scrape type for UD35808: 0
2025-12-05 17:02:07 [auto1.fr] INFO: Found listing with ID: DJ95926
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ95926%27 HTTP/1.1" 200 None
2025-12-05 17:02:07 [auto1.fr] INFO: Scrape type for DJ95926: 0
2025-12-05 17:02:07 [auto1.fr] INFO: Found listing with ID: TZ95373
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ95373%27 HTTP/1.1" 200 None
2025-12-05 17:02:07 [auto1.fr] INFO: Scrape type for TZ95373: 1
2025-12-05 17:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57b65db0-46f3-5295-9992-4821185fef0d with identifier: FG93607
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57b65db0-46f3-5295-9992-4821185fef0d with identifier: FG93607
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184432 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
184432
2025-12-05 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 57b65db0-46f3-5295-9992-4821185fef0d spider: auto1.fr
2025-12-05 17:02:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 57b65db0-46f3-5295-9992-4821185fef0d due to rule: high_mileage_for_country.json, error: 184432 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
184432
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:37:38Z',
'fuel_type': 'diesel',
'id': '57b65db0-46f3-5295-9992-4821185fef0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG93607',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 184432,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar F-Pace 20d Prestige AWD',
'transmission': 'automatic',
'trim': 'Prestige AWD',
'year': 2017}
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG93607%27 HTTP/1.1" 200 None
2025-12-05 17:02:07 [auto1.fr] INFO: Saving data for FG93607: {'auction_closing_time': 1765039058.0, 'created_time': 1764842776.84193, 'last_price_update_time': 1764954127.975012}
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG93607') HTTP/1.1" 204 0
2025-12-05 17:02:07 [scrapy.extensions.logstats] INFO: Crawled 275 pages (at 156 pages/min), scraped 58 items (at 27 items/min)
2025-12-05 17:02:07 [auto1.fr] INFO: Found listing with ID: DM94438
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM94438%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for DM94438: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: EX15092
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX15092%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for EX15092: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: XY41970
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY41970%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for XY41970: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: MG36399
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG36399%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for MG36399: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: FY95787
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY95787%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for FY95787: 2
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF11400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE03122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: CY73920
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY73920%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for CY73920: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: PP42989
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP42989%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for PP42989: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: ZF82873
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF82873%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for ZF82873: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: AL67606
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL67606%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for AL67606: 0
2025-12-05 17:02:08 [auto1.fr] INFO: Found listing with ID: PN97819
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN97819%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Scrape type for PN97819: 2
2025-12-05 17:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87511527-b080-5bfa-9bab-227ee98ca92c with identifier: DR66532
2025-12-05 17:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87511527-b080-5bfa-9bab-227ee98ca92c with scrape type 2
2025-12-05 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87511527-b080-5bfa-9bab-227ee98ca92c with scrape type 2
2025-12-05 17:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87511527-b080-5bfa-9bab-227ee98ca92c, identifier: DR66532
2025-12-05 17:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3dc24bb-f441-5299-9250-2c4354fa326c with identifier: JS66626
2025-12-05 17:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3dc24bb-f441-5299-9250-2c4354fa326c with scrape type 2
2025-12-05 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3dc24bb-f441-5299-9250-2c4354fa326c with scrape type 2
2025-12-05 17:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3dc24bb-f441-5299-9250-2c4354fa326c, identifier: JS66626
2025-12-05 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW83574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87511527-b080-5bfa-9bab-227ee98ca92c with identifier: DR66532
2025-12-05 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87511527-b080-5bfa-9bab-227ee98ca92c with identifier: DR66532
2025-12-05 17:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87511527-b080-5bfa-9bab-227ee98ca92c with identifier: DR66532 to the API
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR66532>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:02:41Z',
'fuel_type': 'diesel',
'id': '87511527-b080-5bfa-9bab-227ee98ca92c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR66532',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 92000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-28',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Carat',
'transmission': 'automatic',
'trim': 'Carat',
'year': 2021}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR66532%27 HTTP/1.1" 200 None
2025-12-05 17:02:08 [auto1.fr] INFO: Saving data for DR66532: {'auction_closing_time': 1765036961.0, 'created_time': 1763445643.077254, 'last_price_update_time': 1764954128.642644}
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DR66532') HTTP/1.1" 204 0
2025-12-05 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3dc24bb-f441-5299-9250-2c4354fa326c with identifier: JS66626
2025-12-05 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3dc24bb-f441-5299-9250-2c4354fa326c with identifier: JS66626
2025-12-05 17:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3dc24bb-f441-5299-9250-2c4354fa326c with identifier: JS66626 to the API
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS66626>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:19:20Z',
'fuel_type': 'petrol',
'id': 'b3dc24bb-f441-5299-9250-2c4354fa326c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS66626',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 67227,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Carat Exclusive',
'transmission': 'manual',
'trim': 'Carat Exclusive',
'year': 2018}
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS66626%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Saving data for JS66626: {'auction_closing_time': 1765037960.0, 'created_time': 1764756426.995733, 'last_price_update_time': 1764954129.078688}
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JS66626') HTTP/1.1" 204 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: UW50233
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW50233%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for UW50233: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: CP52083
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP52083%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for CP52083: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: AY54511
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY54511%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for AY54511: 1
2025-12-05 17:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU69600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: ZU63041
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU63041%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for ZU63041: 1
2025-12-05 17:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: KK34937
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK34937%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for KK34937: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: NC62498
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC62498%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for NC62498: 2
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: MD35990
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD35990%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for MD35990: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: CB99000
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB99000%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for CB99000: 2
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: EW01280
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW01280%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for EW01280: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: LH58819
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH58819%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for LH58819: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: JA37182
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA37182%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for JA37182: 1
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: KL29839
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL29839%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for KL29839: 2
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: SG08119
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG08119%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for SG08119: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: AH29629
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH29629%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for AH29629: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: AU18271
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU18271%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for AU18271: 1
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: RY22396
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY22396%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for RY22396: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: TX80741
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX80741%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for TX80741: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: UK37291
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK37291%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for UK37291: 1
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: FA63392
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA63392%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for FA63392: 2
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: SL74989
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL74989%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for SL74989: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: GX89827
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX89827%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for GX89827: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: ZG85490
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG85490%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for ZG85490: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: YY50983
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY50983%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for YY50983: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: EF33630
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF33630%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for EF33630: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: EH94620
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH94620%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for EH94620: 0
2025-12-05 17:02:09 [auto1.fr] INFO: Found listing with ID: CY34034
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY34034%27 HTTP/1.1" 200 None
2025-12-05 17:02:09 [auto1.fr] INFO: Scrape type for CY34034: 0
2025-12-05 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA67457> (referer: https://www.auto1.com/v1/car-details-view/DA67457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW89332> (referer: https://www.auto1.com/v1/car-details-view/HW89332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ30898> (referer: https://www.auto1.com/v1/car-details-view/XJ30898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG95969> (referer: https://www.auto1.com/v1/car-details-view/UG95969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e907f304-ed51-5848-bac6-0edb0a961d15 with identifier: DA67457
2025-12-05 17:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e907f304-ed51-5848-bac6-0edb0a961d15 with scrape type 1
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_0c306f1e5d63143baba702d856742c98.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_0c306f1e5d63143baba702d856742c98.jpg not downloaded yet
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_d030cdd680c20027f2a6ffd7f5b2e09d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_d030cdd680c20027f2a6ffd7f5b2e09d.jpg not downloaded yet
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_9bb75df60549d327c357764318171a4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_9bb75df60549d327c357764318171a4f.jpg not downloaded yet
2025-12-05 17:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2401559a-d112-529d-8219-a21054d17f87 with identifier: HW89332
2025-12-05 17:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2401559a-d112-529d-8219-a21054d17f87 with scrape type 2
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2401559a-d112-529d-8219-a21054d17f87 with scrape type 2
2025-12-05 17:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2401559a-d112-529d-8219-a21054d17f87, identifier: HW89332
2025-12-05 17:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991 with identifier: XJ30898
2025-12-05 17:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991 with scrape type 2
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991 with scrape type 2
2025-12-05 17:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991, identifier: XJ30898
2025-12-05 17:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb with identifier: UG95969
2025-12-05 17:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb with scrape type 2
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb with scrape type 2
2025-12-05 17:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb, identifier: UG95969
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_98897f076f49212bb92eec00c4d559f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_98897f076f49212bb92eec00c4d559f9.jpg not downloaded yet
2025-12-05 17:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2401559a-d112-529d-8219-a21054d17f87 with identifier: HW89332
2025-12-05 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2401559a-d112-529d-8219-a21054d17f87 with identifier: HW89332
2025-12-05 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 145172, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw89332', 'expiration_date': '2025-12-06t16:41:47z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '2401559a-d112-529d-8219-a21054d17f87', 'current_year_diff': 5, 'age_in_months': 69, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 145172}
Failed validating None in schema:
False
On instance:
{'age_in_months': 69,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:41:47z',
'fuel_type': 'petrol',
'id': '2401559a-d112-529d-8219-a21054d17f87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw89332',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 145172,
'odometer_in_km': 145172,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-17',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech active business',
'transmission': 'automatic',
'trim': 'active business',
'year': 2020}
2025-12-05 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2401559a-d112-529d-8219-a21054d17f87 spider: auto1.fr
2025-12-05 17:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2401559a-d112-529d-8219-a21054d17f87 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 145172, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw89332', 'expiration_date': '2025-12-06t16:41:47z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '2401559a-d112-529d-8219-a21054d17f87', 'current_year_diff': 5, 'age_in_months': 69, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 145172}
Failed validating None in schema:
False
On instance:
{'age_in_months': 69,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:41:47z',
'fuel_type': 'petrol',
'id': '2401559a-d112-529d-8219-a21054d17f87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw89332',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 145172,
'odometer_in_km': 145172,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-17',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech active business',
'transmission': 'automatic',
'trim': 'active business',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:41:47Z',
'fuel_type': 'petrol',
'id': '2401559a-d112-529d-8219-a21054d17f87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW89332',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '5008',
'odometer': 145172,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-17',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2020}
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW89332%27 HTTP/1.1" 200 None
2025-12-05 17:02:10 [auto1.fr] INFO: Saving data for HW89332: {'auction_closing_time': 1765039307.0, 'created_time': 1763744727.547839, 'last_price_update_time': 1764954130.750415}
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW89332') HTTP/1.1" 204 0
2025-12-05 17:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991 with identifier: XJ30898
2025-12-05 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991 with identifier: XJ30898
2025-12-05 17:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d6d31ca-a3dc-51b9-ae6a-30f2152a0991 with identifier: XJ30898 to the API
2025-12-05 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XJ30898>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:47:10Z',
'fuel_type': 'petrol',
'id': '2d6d31ca-a3dc-51b9-ae6a-30f2152a0991',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ30898',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'MINI',
'model': 'MINI',
'odometer': 57055,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-04',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper Classic Trim',
'transmission': 'manual',
'trim': 'Classic Trim',
'year': 2021}
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ30898%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [auto1.fr] INFO: Saving data for XJ30898: {'auction_closing_time': 1765039630.0, 'created_time': 1763028239.685457, 'last_price_update_time': 1764954131.190987}
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XJ30898') HTTP/1.1" 204 0
2025-12-05 17:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb with identifier: UG95969
2025-12-05 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb with identifier: UG95969
2025-12-05 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 88217, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug95969', 'expiration_date': '2025-12-06t16:58:06z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': '5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb', 'current_year_diff': 4, 'age_in_months': 55, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 88217}
Failed validating None in schema:
False
On instance:
{'age_in_months': 55,
'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:58:06z',
'fuel_type': 'petrol',
'id': '5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug95969',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 88217,
'odometer_in_km': 88217,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-22',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
2025-12-05 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb spider: auto1.fr
2025-12-05 17:02:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 88217, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug95969', 'expiration_date': '2025-12-06t16:58:06z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': '5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb', 'current_year_diff': 4, 'age_in_months': 55, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 88217}
Failed validating None in schema:
False
On instance:
{'age_in_months': 55,
'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:58:06z',
'fuel_type': 'petrol',
'id': '5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug95969',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 88217,
'odometer_in_km': 88217,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-22',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:58:06Z',
'fuel_type': 'petrol',
'id': '5bc30be7-b21b-54ee-b71a-cf78eb1ba6bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG95969',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': '5008',
'odometer': 88217,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-22',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG95969%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [auto1.fr] INFO: Saving data for UG95969: {'auction_closing_time': 1765040286.0, 'created_time': 1764756263.589674, 'last_price_update_time': 1764954131.421334}
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG95969') HTTP/1.1" 204 0
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_8afa8d64919b2bcb988edf59a2902bca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8afa8d64919b2bcb988edf59a2902bca.jpg not downloaded yet
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED14527> (referer: https://www.auto1.com/v1/car-details-view/ED14527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG15929> (referer: https://www.auto1.com/v1/car-details-view/MG15929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK16721> (referer: https://www.auto1.com/v1/car-details-view/PK16721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX08162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_dc493297aecedbb5a322bdde8c14c8c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_dc493297aecedbb5a322bdde8c14c8c4.jpg not downloaded yet
2025-12-05 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_50febf284d52d21dadb40e8437874ec1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_50febf284d52d21dadb40e8437874ec1.jpg not downloaded yet
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_43b431971a58e2693aae79106c1658c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_43b431971a58e2693aae79106c1658c5.jpg not downloaded yet
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ea03ded219d054345734944b0cf5b04f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ea03ded219d054345734944b0cf5b04f.jpg not downloaded yet
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ad75c3efe5bc0b8d08f019a371cbb336.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ad75c3efe5bc0b8d08f019a371cbb336.jpg not downloaded yet
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_98897f076f49212bb92eec00c4d559f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_be3cc7ed6ac3d08fce641d56299d75fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_be3cc7ed6ac3d08fce641d56299d75fc.jpg not downloaded yet
2025-12-05 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_9bb75df60549d327c357764318171a4f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 with identifier: ED14527
2025-12-05 17:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 with scrape type 1
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_6591af5f6a5e79da40f611934658da79.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_6591af5f6a5e79da40f611934658da79.jpg not downloaded yet
2025-12-05 17:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e713dc-2d41-52fb-970f-229ff6c7b1be with identifier: MG15929
2025-12-05 17:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e713dc-2d41-52fb-970f-229ff6c7b1be with scrape type 2
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e713dc-2d41-52fb-970f-229ff6c7b1be with scrape type 2
2025-12-05 17:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70e713dc-2d41-52fb-970f-229ff6c7b1be, identifier: MG15929
2025-12-05 17:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29809c44-7bec-5984-9ec7-403c9f37b1b8 with identifier: PK16721
2025-12-05 17:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29809c44-7bec-5984-9ec7-403c9f37b1b8 with scrape type 2
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29809c44-7bec-5984-9ec7-403c9f37b1b8 with scrape type 2
2025-12-05 17:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29809c44-7bec-5984-9ec7-403c9f37b1b8, identifier: PK16721
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_410a396b8479833788d7899dd1feae64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_410a396b8479833788d7899dd1feae64.jpg not downloaded yet
2025-12-05 17:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70e713dc-2d41-52fb-970f-229ff6c7b1be with identifier: MG15929
2025-12-05 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70e713dc-2d41-52fb-970f-229ff6c7b1be with identifier: MG15929
2025-12-05 17:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70e713dc-2d41-52fb-970f-229ff6c7b1be with identifier: MG15929 to the API
2025-12-05 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MG15929>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:27:09Z',
'fuel_type': 'diesel',
'id': '70e713dc-2d41-52fb-970f-229ff6c7b1be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG15929',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '2008',
'odometer': 105129,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2021}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG15929%27 HTTP/1.1" 200 None
2025-12-05 17:02:12 [auto1.fr] INFO: Saving data for MG15929: {'auction_closing_time': 1765038429.0, 'created_time': 1764151614.925675, 'last_price_update_time': 1764954132.200377}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG15929') HTTP/1.1" 204 0
2025-12-05 17:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29809c44-7bec-5984-9ec7-403c9f37b1b8 with identifier: PK16721
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29809c44-7bec-5984-9ec7-403c9f37b1b8 with identifier: PK16721
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170021 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170021
2025-12-05 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29809c44-7bec-5984-9ec7-403c9f37b1b8 spider: auto1.fr
2025-12-05 17:02:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 29809c44-7bec-5984-9ec7-403c9f37b1b8 due to rule: high_mileage_for_country.json, error: 170021 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170021
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:18:24Z',
'fuel_type': 'diesel',
'id': '29809c44-7bec-5984-9ec7-403c9f37b1b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK16721',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Skoda',
'model': 'Superb',
'odometer': 170021,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2018}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK16721%27 HTTP/1.1" 200 None
2025-12-05 17:02:12 [auto1.fr] INFO: Saving data for PK16721: {'auction_closing_time': 1765037904.0, 'created_time': 1764756071.226218, 'last_price_update_time': 1764954132.45868}
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK16721') HTTP/1.1" 204 0
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_d030cdd680c20027f2a6ffd7f5b2e09d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_be7ce068b2c878d55ebf5994306f9568.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_be7ce068b2c878d55ebf5994306f9568.jpg not downloaded yet
2025-12-05 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8afa8d64919b2bcb988edf59a2902bca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ecfc4af30e2175d9d41c085713aee32d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ecfc4af30e2175d9d41c085713aee32d.jpg not downloaded yet
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdd050>
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_98897f076f49212bb92eec00c4d559f9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_98897f076f49212bb92eec00c4d559f9.jpg saved to cache
2025-12-05 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1d550>
2025-12-05 17:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_9bb75df60549d327c357764318171a4f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_9bb75df60549d327c357764318171a4f.jpg saved to cache
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_4e6d911a2a74281c3c2606b99f170d6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_4e6d911a2a74281c3c2606b99f170d6a.jpg not downloaded yet
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH50075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP35397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP07741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ea03ded219d054345734944b0cf5b04f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ad75c3efe5bc0b8d08f019a371cbb336.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ac1c64f022a646dc4f8880322238068a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ac1c64f022a646dc4f8880322238068a.jpg not downloaded yet
2025-12-05 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_1e91ece7b6b1f048370e2b76f85fc486.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1e91ece7b6b1f048370e2b76f85fc486.jpg not downloaded yet
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY81373> (referer: https://www.auto1.com/v1/car-details-view/LY81373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f99d0>
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_d030cdd680c20027f2a6ffd7f5b2e09d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_d030cdd680c20027f2a6ffd7f5b2e09d.jpg saved to cache
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b37d0>
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_8afa8d64919b2bcb988edf59a2902bca.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8afa8d64919b2bcb988edf59a2902bca.jpg saved to cache
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_16d0c6a44a3d9a5f17235043457b1f65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_16d0c6a44a3d9a5f17235043457b1f65.jpg not downloaded yet
2025-12-05 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_410a396b8479833788d7899dd1feae64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_bed35c6220ba32037ab7ea5123706b10.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_bed35c6220ba32037ab7ea5123706b10.jpg not downloaded yet
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_6eba3526b13ec580a74d2b029bb48b40.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_6eba3526b13ec580a74d2b029bb48b40.jpg not downloaded yet
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ95373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY54511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_61bca06f2825e2ac72d40a9e358b303a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_61bca06f2825e2ac72d40a9e358b303a.jpg not downloaded yet
2025-12-05 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ecfc4af30e2175d9d41c085713aee32d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_be7ce068b2c878d55ebf5994306f9568.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_6591af5f6a5e79da40f611934658da79.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_38128187f96ada25ce200586b0e35dfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_38128187f96ada25ce200586b0e35dfa.jpg not downloaded yet
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c453d0>
2025-12-05 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ea03ded219d054345734944b0cf5b04f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ea03ded219d054345734944b0cf5b04f.jpg saved to cache
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e6ab50>
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ad75c3efe5bc0b8d08f019a371cbb336.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ad75c3efe5bc0b8d08f019a371cbb336.jpg saved to cache
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2 with identifier: LY81373
2025-12-05 17:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2 with scrape type 2
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2 with scrape type 2
2025-12-05 17:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2, identifier: LY81373
2025-12-05 17:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_be3cc7ed6ac3d08fce641d56299d75fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_43b431971a58e2693aae79106c1658c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_1fc3fcc66a4e3905c477a905f6fdf9ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1fc3fcc66a4e3905c477a905f6fdf9ea.jpg not downloaded yet
2025-12-05 17:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN97819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2 with identifier: LY81373
2025-12-05 17:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2 with identifier: LY81373
2025-12-05 17:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2 with identifier: LY81373 to the API
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY81373>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 245,
'expiration_date': '2025-12-06T16:08:46Z',
'fuel_type': 'petrol',
'id': '3e6ed0e5-b0fc-5078-98ea-e96ceb165ee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY81373',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 124616,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
'transmission': 'automatic',
'trim': 'GTI Performance BlueMotion',
'year': 2018}
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY81373%27 HTTP/1.1" 200 None
2025-12-05 17:02:14 [auto1.fr] INFO: Saving data for LY81373: {'auction_closing_time': 1765037326.0, 'created_time': 1764842774.269558, 'last_price_update_time': 1764954134.924407}
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LY81373') HTTP/1.1" 204 0
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_4a6c52ad4ef09a8d51f1cab66d27fcab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_4a6c52ad4ef09a8d51f1cab66d27fcab.jpg not downloaded yet
2025-12-05 17:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e02b50>
2025-12-05 17:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_410a396b8479833788d7899dd1feae64.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_410a396b8479833788d7899dd1feae64.jpg saved to cache
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ac1c64f022a646dc4f8880322238068a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1e91ece7b6b1f048370e2b76f85fc486.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_017d153b908d053ddcca6fdf69d054a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_017d153b908d053ddcca6fdf69d054a5.jpg not downloaded yet
2025-12-05 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY95787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d03f50>
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ecfc4af30e2175d9d41c085713aee32d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ecfc4af30e2175d9d41c085713aee32d.jpg saved to cache
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d14090>
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_be7ce068b2c878d55ebf5994306f9568.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_be7ce068b2c878d55ebf5994306f9568.jpg saved to cache
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d0ef90>
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_6591af5f6a5e79da40f611934658da79.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_6591af5f6a5e79da40f611934658da79.jpg saved to cache
2025-12-05 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_16d0c6a44a3d9a5f17235043457b1f65.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_6eba3526b13ec580a74d2b029bb48b40.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_8c528d181e3870184be8c510ffdb4e2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8c528d181e3870184be8c510ffdb4e2f.jpg not downloaded yet
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f4d10>
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_be3cc7ed6ac3d08fce641d56299d75fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_be3cc7ed6ac3d08fce641d56299d75fc.jpg saved to cache
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df5550>
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_43b431971a58e2693aae79106c1658c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_43b431971a58e2693aae79106c1658c5.jpg saved to cache
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_61bca06f2825e2ac72d40a9e358b303a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_50febf284d52d21dadb40e8437874ec1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_bed35c6220ba32037ab7ea5123706b10.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_4e6d911a2a74281c3c2606b99f170d6a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_3a172d18fad3c7283d47abe5ef16d4d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_3a172d18fad3c7283d47abe5ef16d4d4.jpg not downloaded yet
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA63392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU18271/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7d5d0>
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_ac1c64f022a646dc4f8880322238068a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ac1c64f022a646dc4f8880322238068a.jpg saved to cache
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ede90>
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_1e91ece7b6b1f048370e2b76f85fc486.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1e91ece7b6b1f048370e2b76f85fc486.jpg saved to cache
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_dc493297aecedbb5a322bdde8c14c8c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_f531c2453c0d63fb257af3f7f6add37b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f531c2453c0d63fb257af3f7f6add37b.jpg not downloaded yet
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK37291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de0810>
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_16d0c6a44a3d9a5f17235043457b1f65.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_16d0c6a44a3d9a5f17235043457b1f65.jpg saved to cache
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f0b90>
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_6eba3526b13ec580a74d2b029bb48b40.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_6eba3526b13ec580a74d2b029bb48b40.jpg saved to cache
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_4a6c52ad4ef09a8d51f1cab66d27fcab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_38128187f96ada25ce200586b0e35dfa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_0c306f1e5d63143baba702d856742c98.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1fc3fcc66a4e3905c477a905f6fdf9ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_805fdf9c536282117f62f4e28c137e60.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_805fdf9c536282117f62f4e28c137e60.jpg not downloaded yet
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX08162> (referer: https://www.auto1.com/v1/car-details-view/KX08162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU69600> (referer: https://www.auto1.com/v1/car-details-view/XU69600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c587a650>
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_61bca06f2825e2ac72d40a9e358b303a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_61bca06f2825e2ac72d40a9e358b303a.jpg saved to cache
2025-12-05 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f6f50>
2025-12-05 17:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_50febf284d52d21dadb40e8437874ec1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_50febf284d52d21dadb40e8437874ec1.jpg saved to cache
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdd7d0>
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_bed35c6220ba32037ab7ea5123706b10.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_bed35c6220ba32037ab7ea5123706b10.jpg saved to cache
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ac1d0>
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_4e6d911a2a74281c3c2606b99f170d6a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_4e6d911a2a74281c3c2606b99f170d6a.jpg saved to cache
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_017d153b908d053ddcca6fdf69d054a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d7fc10>
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_dc493297aecedbb5a322bdde8c14c8c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_dc493297aecedbb5a322bdde8c14c8c4.jpg saved to cache
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8c528d181e3870184be8c510ffdb4e2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_2f7f7edae6af7e634b3a026ab989f209.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_2f7f7edae6af7e634b3a026ab989f209.jpg not downloaded yet
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_3a172d18fad3c7283d47abe5ef16d4d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP07741> (referer: https://www.auto1.com/v1/car-details-view/JP07741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP35397> (referer: https://www.auto1.com/v1/car-details-view/JP35397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ceed0>
2025-12-05 17:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_4a6c52ad4ef09a8d51f1cab66d27fcab.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_4a6c52ad4ef09a8d51f1cab66d27fcab.jpg saved to cache
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585e9d0>
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_38128187f96ada25ce200586b0e35dfa.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_38128187f96ada25ce200586b0e35dfa.jpg saved to cache
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5812410>
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_0c306f1e5d63143baba702d856742c98.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_0c306f1e5d63143baba702d856742c98.jpg saved to cache
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58248d0>
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_1fc3fcc66a4e3905c477a905f6fdf9ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1fc3fcc66a4e3905c477a905f6fdf9ea.jpg saved to cache
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 with identifier: KX08162
2025-12-05 17:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 with scrape type 2
2025-12-05 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 with scrape type 2
2025-12-05 17:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5, identifier: KX08162
2025-12-05 17:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a70e7a2-67ae-5fef-b722-ad5f308d1455 with identifier: XU69600
2025-12-05 17:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a70e7a2-67ae-5fef-b722-ad5f308d1455 with scrape type 2
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a70e7a2-67ae-5fef-b722-ad5f308d1455 with scrape type 2
2025-12-05 17:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a70e7a2-67ae-5fef-b722-ad5f308d1455, identifier: XU69600
2025-12-05 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f531c2453c0d63fb257af3f7f6add37b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_1ab6c36a05e5b7dd26c55cc2be63883d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1ab6c36a05e5b7dd26c55cc2be63883d.jpg not downloaded yet
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 with identifier: KX08162
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 with identifier: KX08162
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152206 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152206
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 spider: auto1.fr
2025-12-05 17:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 235c24f2-180c-5bd3-9681-4cb0cfbbf7e5 due to rule: high_mileage_for_country.json, error: 152206 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152206
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:12:45Z',
'fuel_type': 'diesel',
'id': '235c24f2-180c-5bd3-9681-4cb0cfbbf7e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX08162',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 152206,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX08162%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [auto1.fr] INFO: Saving data for KX08162: {'auction_closing_time': 1765037565.0, 'created_time': 1764262922.308869, 'last_price_update_time': 1764954140.429441}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX08162') HTTP/1.1" 204 0
2025-12-05 17:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a70e7a2-67ae-5fef-b722-ad5f308d1455 with identifier: XU69600
2025-12-05 17:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a70e7a2-67ae-5fef-b722-ad5f308d1455 with identifier: XU69600
2025-12-05 17:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a70e7a2-67ae-5fef-b722-ad5f308d1455 with identifier: XU69600 to the API
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XU69600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:54:54Z',
'fuel_type': 'gas',
'id': '6a70e7a2-67ae-5fef-b722-ad5f308d1455',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU69600',
'listing': 'auction',
'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 18605,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-02-13',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Essential',
'transmission': 'manual',
'trim': 'Stepway Essential',
'year': 2024}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU69600%27 HTTP/1.1" 200 None
2025-12-05 17:02:20 [auto1.fr] INFO: Saving data for XU69600: {'auction_closing_time': 1765040094.0, 'created_time': 1764842665.270269, 'last_price_update_time': 1764954140.770083}
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XU69600') HTTP/1.1" 204 0
2025-12-05 17:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d0a690>
2025-12-05 17:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_017d153b908d053ddcca6fdf69d054a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_017d153b908d053ddcca6fdf69d054a5.jpg saved to cache
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_7d77ce66d5a40380388ca57c7fc8f064.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_7d77ce66d5a40380388ca57c7fc8f064.jpg not downloaded yet
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY54511> (referer: https://www.auto1.com/v1/car-details-view/AY54511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH50075> (referer: https://www.auto1.com/v1/car-details-view/JH50075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582b8d0>
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F51%252Fc2516c3a1cc57113755e622769eeabd2%252Fpa%252FDA67457_8c528d181e3870184be8c510ffdb4e2f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8c528d181e3870184be8c510ffdb4e2f.jpg saved to cache
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e907f304-ed51-5848-bac6-0edb0a961d15
2025-12-05 17:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e907f304-ed51-5848-bac6-0edb0a961d15, skipping ID generation
2025-12-05 17:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e907f304-ed51-5848-bac6-0edb0a961d15 with scrape type 1
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e907f304-ed51-5848-bac6-0edb0a961d15 from tracking dictionaries
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e907f304-ed51-5848-bac6-0edb0a961d15 sending to next pipeline
2025-12-05 17:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e907f304-ed51-5848-bac6-0edb0a961d15, identifier: DA67457
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5828950>
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_3a172d18fad3c7283d47abe5ef16d4d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_3a172d18fad3c7283d47abe5ef16d4d4.jpg saved to cache
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330427a7-4bbe-50b0-a68c-0d49347673b5 with identifier: JP07741
2025-12-05 17:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330427a7-4bbe-50b0-a68c-0d49347673b5 with scrape type 2
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330427a7-4bbe-50b0-a68c-0d49347673b5 with scrape type 2
2025-12-05 17:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 330427a7-4bbe-50b0-a68c-0d49347673b5, identifier: JP07741
2025-12-05 17:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26ef565-5b59-58f8-944e-6f2c89e1d74d with identifier: JP35397
2025-12-05 17:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26ef565-5b59-58f8-944e-6f2c89e1d74d with scrape type 2
2025-12-05 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d26ef565-5b59-58f8-944e-6f2c89e1d74d with scrape type 2
2025-12-05 17:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d26ef565-5b59-58f8-944e-6f2c89e1d74d, identifier: JP35397
2025-12-05 17:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e907f304-ed51-5848-bac6-0edb0a961d15 with identifier: DA67457
2025-12-05 17:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e907f304-ed51-5848-bac6-0edb0a961d15 with identifier: DA67457
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164058 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164058
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e907f304-ed51-5848-bac6-0edb0a961d15 spider: auto1.fr
2025-12-05 17:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e907f304-ed51-5848-bac6-0edb0a961d15 due to rule: high_mileage_for_country.json, error: 164058 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164058
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:13:50Z',
'fuel_type': 'diesel',
'id': 'e907f304-ed51-5848-bac6-0edb0a961d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA67457',
'listing': 'auction',
'location': 'FR',
'make': 'Ford',
'model': 'Kuga',
'odometer': 164058,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_0c306f1e5d63143baba702d856742c98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_d030cdd680c20027f2a6ffd7f5b2e09d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_9bb75df60549d327c357764318171a4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_98897f076f49212bb92eec00c4d559f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8afa8d64919b2bcb988edf59a2902bca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_dc493297aecedbb5a322bdde8c14c8c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_50febf284d52d21dadb40e8437874ec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_43b431971a58e2693aae79106c1658c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ea03ded219d054345734944b0cf5b04f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ad75c3efe5bc0b8d08f019a371cbb336.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_be3cc7ed6ac3d08fce641d56299d75fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_410a396b8479833788d7899dd1feae64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ecfc4af30e2175d9d41c085713aee32d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_ac1c64f022a646dc4f8880322238068a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_16d0c6a44a3d9a5f17235043457b1f65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_6eba3526b13ec580a74d2b029bb48b40.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_38128187f96ada25ce200586b0e35dfa.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26960,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_4a6c52ad4ef09a8d51f1cab66d27fcab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e907f304-ed51-5848-bac6-0edb0a961d15/e907f304-ed51-5848-bac6-0edb0a961d15_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16910,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/51/c2516c3a1cc57113755e622769eeabd2/pa/DA67457_8c528d181e3870184be8c510ffdb4e2f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA67457%27 HTTP/1.1" 200 None
2025-12-05 17:02:22 [auto1.fr] INFO: Saving data for DA67457: {'created_time': 1764954142.186471, 'last_price_update_time': 1764954142.186481, 'auction_closing_time': 1765037630.0}
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA67457') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 330427a7-4bbe-50b0-a68c-0d49347673b5 with identifier: JP07741
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 330427a7-4bbe-50b0-a68c-0d49347673b5 with identifier: JP07741
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 63786, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp07741', 'expiration_date': '2025-12-06t16:58:17z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, vezin-le-coquet', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '330427a7-4bbe-50b0-a68c-0d49347673b5', 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63786}
Failed validating None in schema:
False
On instance:
{'age_in_months': 90,
'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:58:17z',
'fuel_type': 'petrol',
'id': '330427a7-4bbe-50b0-a68c-0d49347673b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp07741',
'listing': 'auction',
'location': 'fr, vezin-le-coquet',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 63786,
'odometer_in_km': 63786,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2018}
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 330427a7-4bbe-50b0-a68c-0d49347673b5 spider: auto1.fr
2025-12-05 17:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 330427a7-4bbe-50b0-a68c-0d49347673b5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 63786, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp07741', 'expiration_date': '2025-12-06t16:58:17z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, vezin-le-coquet', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '330427a7-4bbe-50b0-a68c-0d49347673b5', 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63786}
Failed validating None in schema:
False
On instance:
{'age_in_months': 90,
'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:58:17z',
'fuel_type': 'petrol',
'id': '330427a7-4bbe-50b0-a68c-0d49347673b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp07741',
'listing': 'auction',
'location': 'fr, vezin-le-coquet',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 63786,
'odometer_in_km': 63786,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:58:17Z',
'fuel_type': 'petrol',
'id': '330427a7-4bbe-50b0-a68c-0d49347673b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP07741',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Peugeot',
'model': '3008',
'odometer': 63786,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP07741%27 HTTP/1.1" 200 None
2025-12-05 17:02:22 [auto1.fr] INFO: Saving data for JP07741: {'auction_closing_time': 1765040297.0, 'created_time': 1764842719.060051, 'last_price_update_time': 1764954142.436215}
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP07741') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d26ef565-5b59-58f8-944e-6f2c89e1d74d with identifier: JP35397
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d26ef565-5b59-58f8-944e-6f2c89e1d74d with identifier: JP35397
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193064 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
193064
2025-12-05 17:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d26ef565-5b59-58f8-944e-6f2c89e1d74d spider: auto1.fr
2025-12-05 17:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d26ef565-5b59-58f8-944e-6f2c89e1d74d due to rule: high_mileage_for_country.json, error: 193064 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
193064
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2025-12-06T16:03:16Z',
'fuel_type': 'diesel',
'id': 'd26ef565-5b59-58f8-944e-6f2c89e1d74d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP35397',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 193064,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Super Q4',
'transmission': 'automatic',
'trim': 'Super Q4',
'year': 2018}
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP35397%27 HTTP/1.1" 200 None
2025-12-05 17:02:22 [auto1.fr] INFO: Saving data for JP35397: {'auction_closing_time': 1765036996.0, 'created_time': 1764842545.397839, 'last_price_update_time': 1764954142.673884}
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP35397') HTTP/1.1" 204 0
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4efc110>
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_f531c2453c0d63fb257af3f7f6add37b.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f531c2453c0d63fb257af3f7f6add37b.jpg saved to cache
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_2f7f7edae6af7e634b3a026ab989f209.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_f1b5ed2e04f05984db0aa7e1a9bc76a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f1b5ed2e04f05984db0aa7e1a9bc76a6.jpg not downloaded yet
2025-12-05 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_805fdf9c536282117f62f4e28c137e60.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ95373> (referer: https://www.auto1.com/v1/car-details-view/TZ95373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d16719b-7728-5160-9ec4-52e66e7dfe65 with identifier: AY54511
2025-12-05 17:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d16719b-7728-5160-9ec4-52e66e7dfe65 with scrape type 1
2025-12-05 17:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_38d06bee002dbdeda16c159706adf9ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg not downloaded yet
2025-12-05 17:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7200832c-36f7-5045-87e5-4afc3befd0ef with identifier: JH50075
2025-12-05 17:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7200832c-36f7-5045-87e5-4afc3befd0ef with scrape type 2
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7200832c-36f7-5045-87e5-4afc3befd0ef with scrape type 2
2025-12-05 17:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7200832c-36f7-5045-87e5-4afc3befd0ef, identifier: JH50075
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_fd713b7c942bd8b6b853e9485d9b8673.png%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_fd713b7c942bd8b6b853e9485d9b8673.png not downloaded yet
2025-12-05 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7200832c-36f7-5045-87e5-4afc3befd0ef with identifier: JH50075
2025-12-05 17:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7200832c-36f7-5045-87e5-4afc3befd0ef with identifier: JH50075
2025-12-05 17:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163523 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163523
2025-12-05 17:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7200832c-36f7-5045-87e5-4afc3befd0ef spider: auto1.fr
2025-12-05 17:02:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7200832c-36f7-5045-87e5-4afc3befd0ef due to rule: high_mileage_for_country.json, error: 163523 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163523
{'auction_title': '',
'c_o_2_emission_value': 40,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 204,
'expiration_date': '2025-12-06T16:57:36Z',
'fuel_type': 'hybrid',
'id': '7200832c-36f7-5045-87e5-4afc3befd0ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH50075',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 163523,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2017}
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH50075%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [auto1.fr] INFO: Saving data for JH50075: {'auction_closing_time': 1765040256.0, 'created_time': 1764748840.128908, 'last_price_update_time': 1764954143.384857}
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JH50075') HTTP/1.1" 204 0
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1ab6c36a05e5b7dd26c55cc2be63883d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_618f596948b62481a89d8011af4d3052.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg not downloaded yet
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_7d77ce66d5a40380388ca57c7fc8f064.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57dc750>
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_2f7f7edae6af7e634b3a026ab989f209.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_2f7f7edae6af7e634b3a026ab989f209.jpg saved to cache
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e65f50>
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_805fdf9c536282117f62f4e28c137e60.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_805fdf9c536282117f62f4e28c137e60.jpg saved to cache
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 583f3a1a-fa34-576f-b8aa-75d1ec6f797c with identifier: TZ95373
2025-12-05 17:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c with scrape type 1
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_424e0bf6b930f91a381bf95c8bd183ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_424e0bf6b930f91a381bf95c8bd183ed.jpg not downloaded yet
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_d1a61065626602847fb203c5788802b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg not downloaded yet
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_ed92150eb6b0f135609d0eb83a2e40b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ed92150eb6b0f135609d0eb83a2e40b6.jpg not downloaded yet
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f1b5ed2e04f05984db0aa7e1a9bc76a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_584276307a0fd8d9f6186660938e28aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg not downloaded yet
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA37182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN97819> (referer: https://www.auto1.com/v1/car-details-view/PN97819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9e550>
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_1ab6c36a05e5b7dd26c55cc2be63883d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1ab6c36a05e5b7dd26c55cc2be63883d.jpg saved to cache
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591ae50>
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_7d77ce66d5a40380388ca57c7fc8f064.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_7d77ce66d5a40380388ca57c7fc8f064.jpg saved to cache
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_d3bb1e3e168eb48061dc7b1f2def24b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_d3bb1e3e168eb48061dc7b1f2def24b8.jpg not downloaded yet
2025-12-05 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_ca96992bd45cd71761ec266de0623732.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg not downloaded yet
2025-12-05 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_fd713b7c942bd8b6b853e9485d9b8673.png> (referer: https://www.auto1.com/)
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_81938a1cda0c086b51886670c52a4547.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_81938a1cda0c086b51886670c52a4547.jpg not downloaded yet
2025-12-05 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY95787> (referer: https://www.auto1.com/v1/car-details-view/FY95787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f1f10>
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_f1b5ed2e04f05984db0aa7e1a9bc76a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f1b5ed2e04f05984db0aa7e1a9bc76a6.jpg saved to cache
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 with identifier: PN97819
2025-12-05 17:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 with scrape type 2
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 with scrape type 2
2025-12-05 17:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ced5ee7-0dc7-5f5b-b985-8747ce42a370, identifier: PN97819
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_fc2854e14031dc877630db8843e8aa14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg not downloaded yet
2025-12-05 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 with identifier: PN97819
2025-12-05 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 with identifier: PN97819
2025-12-05 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 56326, 'odometer_reading_unit': 'km', 'registration_date': '2017-06-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pn97819', 'expiration_date': '2025-12-06t16:18:42z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '3ced5ee7-0dc7-5f5b-b985-8747ce42a370', 'current_year_diff': 8, 'age_in_months': 101, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 56326}
Failed validating None in schema:
False
On instance:
{'age_in_months': 101,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:18:42z',
'fuel_type': 'petrol',
'id': '3ced5ee7-0dc7-5f5b-b985-8747ce42a370',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pn97819',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 56326,
'odometer_in_km': 56326,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
2025-12-05 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 spider: auto1.fr
2025-12-05 17:02:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3ced5ee7-0dc7-5f5b-b985-8747ce42a370 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 56326, 'odometer_reading_unit': 'km', 'registration_date': '2017-06-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pn97819', 'expiration_date': '2025-12-06t16:18:42z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '3ced5ee7-0dc7-5f5b-b985-8747ce42a370', 'current_year_diff': 8, 'age_in_months': 101, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 56326}
Failed validating None in schema:
False
On instance:
{'age_in_months': 101,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:18:42z',
'fuel_type': 'petrol',
'id': '3ced5ee7-0dc7-5f5b-b985-8747ce42a370',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pn97819',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 56326,
'odometer_in_km': 56326,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:18:42Z',
'fuel_type': 'petrol',
'id': '3ced5ee7-0dc7-5f5b-b985-8747ce42a370',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN97819',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Peugeot',
'model': '2008',
'odometer': 56326,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN97819%27 HTTP/1.1" 200 None
2025-12-05 17:02:25 [auto1.fr] INFO: Saving data for PN97819: {'auction_closing_time': 1765037922.0, 'created_time': 1764756237.49724, 'last_price_update_time': 1764954145.084008}
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PN97819') HTTP/1.1" 204 0
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_858f6f937606a274a1ea369184eaf8aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_858f6f937606a274a1ea369184eaf8aa.jpg not downloaded yet
2025-12-05 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ed92150eb6b0f135609d0eb83a2e40b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_a47757b42829590d18c7b498ec8a3bc8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg not downloaded yet
2025-12-05 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC62498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW83574> (referer: https://www.auto1.com/v1/car-details-view/SW83574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:25 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:02:25 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:02:25 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:02:25 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583e290>
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_15.png HTTP/1.1" 201 0
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F79%252F4979672a5d59523f06ae36388351e242%252Fpa%252FED14527_fd713b7c942bd8b6b853e9485d9b8673.png') HTTP/1.1" 204 0
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_fd713b7c942bd8b6b853e9485d9b8673.png saved to cache
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3
2025-12-05 17:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3, skipping ID generation
2025-12-05 17:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 with scrape type 1
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 from tracking dictionaries
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 sending to next pipeline
2025-12-05 17:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3, identifier: ED14527
2025-12-05 17:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f637b9f4-6896-585a-bff4-9489d950cbfe with identifier: FY95787
2025-12-05 17:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f637b9f4-6896-585a-bff4-9489d950cbfe with scrape type 2
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f637b9f4-6896-585a-bff4-9489d950cbfe with scrape type 2
2025-12-05 17:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f637b9f4-6896-585a-bff4-9489d950cbfe, identifier: FY95787
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_0af20f069d1352074fd17c11a36eecf4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0af20f069d1352074fd17c11a36eecf4.jpg not downloaded yet
2025-12-05 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 with identifier: ED14527
2025-12-05 17:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 with identifier: ED14527
2025-12-05 17:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19ca6ca1-fc1a-500f-9a8c-da5842fa0da3 with identifier: ED14527 to the API
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_fd713b7c942bd8b6b853e9485d9b8673.png>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:34:26Z',
'fuel_type': 'diesel',
'id': '19ca6ca1-fc1a-500f-9a8c-da5842fa0da3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED14527',
'listing': 'auction',
'location': 'FR, Saint-Léonard',
'make': 'Renault',
'model': 'Megane',
'odometer': 123199,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_6591af5f6a5e79da40f611934658da79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_be7ce068b2c878d55ebf5994306f9568.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_4e6d911a2a74281c3c2606b99f170d6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1e91ece7b6b1f048370e2b76f85fc486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_bed35c6220ba32037ab7ea5123706b10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_61bca06f2825e2ac72d40a9e358b303a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1fc3fcc66a4e3905c477a905f6fdf9ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_017d153b908d053ddcca6fdf69d054a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_3a172d18fad3c7283d47abe5ef16d4d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f531c2453c0d63fb257af3f7f6add37b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_805fdf9c536282117f62f4e28c137e60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_2f7f7edae6af7e634b3a026ab989f209.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_1ab6c36a05e5b7dd26c55cc2be63883d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_7d77ce66d5a40380388ca57c7fc8f064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_f1b5ed2e04f05984db0aa7e1a9bc76a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ca6ca1-fc1a-500f-9a8c-da5842fa0da3/19ca6ca1-fc1a-500f-9a8c-da5842fa0da3_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70954,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img49/79/4979672a5d59523f06ae36388351e242/pa/ED14527_fd713b7c942bd8b6b853e9485d9b8673.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.7 BLUE dCi GT-Line',
'transmission': 'automatic',
'trim': 'GT-Line',
'year': 2020}
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED14527%27 HTTP/1.1" 200 None
2025-12-05 17:02:25 [auto1.fr] INFO: Saving data for ED14527: {'created_time': 1764954145.981923, 'last_price_update_time': 1764954145.981932, 'auction_closing_time': 1765038866.0}
2025-12-05 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED14527') HTTP/1.1" 204 0
2025-12-05 17:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f637b9f4-6896-585a-bff4-9489d950cbfe with identifier: FY95787
2025-12-05 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f637b9f4-6896-585a-bff4-9489d950cbfe with identifier: FY95787
2025-12-05 17:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f637b9f4-6896-585a-bff4-9489d950cbfe with identifier: FY95787 to the API
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FY95787>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:46:08Z',
'fuel_type': 'petrol',
'id': 'f637b9f4-6896-585a-bff4-9489d950cbfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY95787',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 73414,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY95787%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [auto1.fr] INFO: Saving data for FY95787: {'auction_closing_time': 1765039568.0, 'created_time': 1764237814.681136, 'last_price_update_time': 1764954146.306607}
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FY95787') HTTP/1.1" 204 0
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_a4e4625db958f84873314b5848b4b055.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg not downloaded yet
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_dd5f23d1087ca839d1d15ac0d32883f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_dd5f23d1087ca839d1d15ac0d32883f5.jpg not downloaded yet
2025-12-05 17:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE03122> (referer: https://www.auto1.com/v1/car-details-view/FE03122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg not downloaded yet
2025-12-05 17:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL29839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e5210>
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_ed92150eb6b0f135609d0eb83a2e40b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ed92150eb6b0f135609d0eb83a2e40b6.jpg saved to cache
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1681af-ae48-5e70-9441-d491e63b3c35 with identifier: SW83574
2025-12-05 17:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1681af-ae48-5e70-9441-d491e63b3c35 with scrape type 2
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1681af-ae48-5e70-9441-d491e63b3c35 with scrape type 2
2025-12-05 17:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce1681af-ae48-5e70-9441-d491e63b3c35, identifier: SW83574
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_f24f8093053d02dbe6573e741a4c8d76.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f24f8093053d02dbe6573e741a4c8d76.jpg not downloaded yet
2025-12-05 17:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce1681af-ae48-5e70-9441-d491e63b3c35 with identifier: SW83574
2025-12-05 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce1681af-ae48-5e70-9441-d491e63b3c35 with identifier: SW83574
2025-12-05 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 85173, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sw83574', 'expiration_date': '2025-12-06t16:27:17z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'ce1681af-ae48-5e70-9441-d491e63b3c35', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 85173}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:27:17z',
'fuel_type': 'petrol',
'id': 'ce1681af-ae48-5e70-9441-d491e63b3c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sw83574',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 85173,
'odometer_in_km': 85173,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-14',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2016}
2025-12-05 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ce1681af-ae48-5e70-9441-d491e63b3c35 spider: auto1.fr
2025-12-05 17:02:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ce1681af-ae48-5e70-9441-d491e63b3c35 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 85173, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sw83574', 'expiration_date': '2025-12-06t16:27:17z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'ce1681af-ae48-5e70-9441-d491e63b3c35', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 85173}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:27:17z',
'fuel_type': 'petrol',
'id': 'ce1681af-ae48-5e70-9441-d491e63b3c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sw83574',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 85173,
'odometer_in_km': 85173,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-14',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:27:17Z',
'fuel_type': 'petrol',
'id': 'ce1681af-ae48-5e70-9441-d491e63b3c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW83574',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C3',
'odometer': 85173,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2016}
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW83574%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [auto1.fr] INFO: Saving data for SW83574: {'auction_closing_time': 1765038437.0, 'created_time': 1764842678.592209, 'last_price_update_time': 1764954146.939319}
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW83574') HTTP/1.1" 204 0
2025-12-05 17:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_858f6f937606a274a1ea369184eaf8aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg not downloaded yet
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_512539ec3347a50908ef7f58346d1276.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_512539ec3347a50908ef7f58346d1276.jpg not downloaded yet
2025-12-05 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a97a788-1bd4-5e8d-b044-5cc44d849f9e with identifier: FE03122
2025-12-05 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a97a788-1bd4-5e8d-b044-5cc44d849f9e with scrape type 2
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a97a788-1bd4-5e8d-b044-5cc44d849f9e with scrape type 2
2025-12-05 17:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a97a788-1bd4-5e8d-b044-5cc44d849f9e, identifier: FE03122
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg not downloaded yet
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB99000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a97a788-1bd4-5e8d-b044-5cc44d849f9e with identifier: FE03122
2025-12-05 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a97a788-1bd4-5e8d-b044-5cc44d849f9e with identifier: FE03122
2025-12-05 17:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a97a788-1bd4-5e8d-b044-5cc44d849f9e with identifier: FE03122 to the API
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FE03122>
{'auction_title': '',
'c_o_2_emission_value': 33,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 158,
'expiration_date': '2025-12-06T16:06:35Z',
'fuel_type': 'hybrid',
'id': '0a97a788-1bd4-5e8d-b044-5cc44d849f9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE03122',
'listing': 'auction',
'location': 'FR, Perpignan',
'make': 'Renault',
'model': 'Captur',
'odometer': 35746,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2021}
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE03122%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [auto1.fr] INFO: Saving data for FE03122: {'auction_closing_time': 1765037195.0, 'created_time': 1764756251.068679, 'last_price_update_time': 1764954147.448254}
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FE03122') HTTP/1.1" 204 0
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_e5308e1ffd81880059135aba8323d86a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_e5308e1ffd81880059135aba8323d86a.jpg not downloaded yet
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU18271> (referer: https://www.auto1.com/v1/car-details-view/AU18271/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_dd5f23d1087ca839d1d15ac0d32883f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg not downloaded yet
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_a5788c5f28d7b7998c993a5608613da5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_a5788c5f28d7b7998c993a5608613da5.jpg not downloaded yet
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK37291> (referer: https://www.auto1.com/v1/car-details-view/UK37291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0b3d0>
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_858f6f937606a274a1ea369184eaf8aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_858f6f937606a274a1ea369184eaf8aa.jpg saved to cache
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg not downloaded yet
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_97509d2707ea4b932115eb4ad02f608c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_97509d2707ea4b932115eb4ad02f608c.jpg not downloaded yet
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg not downloaded yet
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU63041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF11400> (referer: https://www.auto1.com/v1/car-details-view/YF11400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b9f9958-291d-50fe-9e8b-5c5381eefbde with identifier: AU18271
2025-12-05 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde with scrape type 1
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_c08f22e98003ff313b5951e4d07fc980.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_c08f22e98003ff313b5951e4d07fc980.jpg not downloaded yet
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d47690>
2025-12-05 17:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_a4e4625db958f84873314b5848b4b055.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg saved to cache
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ecc1d0>
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_dd5f23d1087ca839d1d15ac0d32883f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_dd5f23d1087ca839d1d15ac0d32883f5.jpg saved to cache
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40cca3ae-18ab-5929-b4e5-ffe55af5a608 with identifier: UK37291
2025-12-05 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cca3ae-18ab-5929-b4e5-ffe55af5a608 with scrape type 1
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 40cca3ae-18ab-5929-b4e5-ffe55af5a608
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_a36de5b62ba6c19541069c31ae48d1af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_a36de5b62ba6c19541069c31ae48d1af.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_c902a68731f83e2afbbf8f6f683f093c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_c902a68731f83e2afbbf8f6f683f093c.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_30277dd6852856d9ac1f7d3eb42dff80.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_30277dd6852856d9ac1f7d3eb42dff80.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_1a120b38b05659875a76f129e69e8fb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_1a120b38b05659875a76f129e69e8fb2.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_e55e92d0edab5884da21ef5c1e828a29.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e55e92d0edab5884da21ef5c1e828a29.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_9452da703b5b614f014dbc051a552662.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_9452da703b5b614f014dbc051a552662.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_ee1c68330b77cf50ffaf2c5ffdc8602f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_ee1c68330b77cf50ffaf2c5ffdc8602f.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_4595799fe956029d3006c174689c155c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_4595799fe956029d3006c174689c155c.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_4b998b30f43294f141574fed32dcbd1c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_4b998b30f43294f141574fed32dcbd1c.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_ba493e0a417a2aacf8f28fddcd17501c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_ba493e0a417a2aacf8f28fddcd17501c.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_c585fa11fac11fb6fb72be699ca9b109.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_c585fa11fac11fb6fb72be699ca9b109.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_e295244ca081e8b33114e69b24cff435.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e295244ca081e8b33114e69b24cff435.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_e7ae47903622b1d9f45b374a006bd2dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e7ae47903622b1d9f45b374a006bd2dd.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_e9dbdb1a77812b5df1134ab961d90889.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e9dbdb1a77812b5df1134ab961d90889.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_5098a600b4a40bc8dd12670994350e1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_5098a600b4a40bc8dd12670994350e1e.jpg already downloaded
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F65%252F5f65dc90864e34bd7605fb72572c2612%252Fpa%252FUK37291_25f3b2d657d6e933084e29c318379cbe.png%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_25f3b2d657d6e933084e29c318379cbe.png already downloaded
2025-12-05 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40cca3ae-18ab-5929-b4e5-ffe55af5a608, identifier: UK37291
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_1e6d1e9595f3b901c10dd42293fc178d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_1e6d1e9595f3b901c10dd42293fc178d.jpg not downloaded yet
2025-12-05 17:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40cca3ae-18ab-5929-b4e5-ffe55af5a608 with identifier: UK37291
2025-12-05 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40cca3ae-18ab-5929-b4e5-ffe55af5a608 with identifier: UK37291
2025-12-05 17:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40cca3ae-18ab-5929-b4e5-ffe55af5a608 with identifier: UK37291 to the API
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK37291>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:52:11Z',
'fuel_type': 'diesel',
'id': '40cca3ae-18ab-5929-b4e5-ffe55af5a608',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK37291',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Kia',
'model': 'Sportage',
'odometer': 146657,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_a36de5b62ba6c19541069c31ae48d1af.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_c902a68731f83e2afbbf8f6f683f093c.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_30277dd6852856d9ac1f7d3eb42dff80.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_1a120b38b05659875a76f129e69e8fb2.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e55e92d0edab5884da21ef5c1e828a29.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_9452da703b5b614f014dbc051a552662.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_ee1c68330b77cf50ffaf2c5ffdc8602f.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_4595799fe956029d3006c174689c155c.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_4b998b30f43294f141574fed32dcbd1c.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_ba493e0a417a2aacf8f28fddcd17501c.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_c585fa11fac11fb6fb72be699ca9b109.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e295244ca081e8b33114e69b24cff435.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e7ae47903622b1d9f45b374a006bd2dd.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e9dbdb1a77812b5df1134ab961d90889.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_5098a600b4a40bc8dd12670994350e1e.jpg',
'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_25f3b2d657d6e933084e29c318379cbe.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_a36de5b62ba6c19541069c31ae48d1af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_c902a68731f83e2afbbf8f6f683f093c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_30277dd6852856d9ac1f7d3eb42dff80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_1a120b38b05659875a76f129e69e8fb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e55e92d0edab5884da21ef5c1e828a29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_9452da703b5b614f014dbc051a552662.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_ee1c68330b77cf50ffaf2c5ffdc8602f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_4595799fe956029d3006c174689c155c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_4b998b30f43294f141574fed32dcbd1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_ba493e0a417a2aacf8f28fddcd17501c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_c585fa11fac11fb6fb72be699ca9b109.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e295244ca081e8b33114e69b24cff435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e7ae47903622b1d9f45b374a006bd2dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_e9dbdb1a77812b5df1134ab961d90889.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_5098a600b4a40bc8dd12670994350e1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cca3ae-18ab-5929-b4e5-ffe55af5a608/40cca3ae-18ab-5929-b4e5-ffe55af5a608_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77093,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img5f/65/5f65dc90864e34bd7605fb72572c2612/pa/UK37291_25f3b2d657d6e933084e29c318379cbe.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Design 2WD',
'transmission': 'automatic',
'trim': 'Design 2WD',
'year': 2019}
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK37291%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [auto1.fr] INFO: Saving data for UK37291: {'created_time': 1764954149.092821, 'last_price_update_time': 1764954149.092832, 'auction_closing_time': 1765039931.0}
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK37291') HTTP/1.1" 204 0
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_02c367dfe19c43d27a3a1ff3004c1d19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_02c367dfe19c43d27a3a1ff3004c1d19.jpg not downloaded yet
2025-12-05 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f24f8093053d02dbe6573e741a4c8d76.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_e5308e1ffd81880059135aba8323d86a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_f727df05791983140f5a600cd413d7e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f727df05791983140f5a600cd413d7e1.jpg not downloaded yet
2025-12-05 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA37182> (referer: https://www.auto1.com/v1/car-details-view/JA37182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f55a4b08-5ea2-59c9-8935-984e5cb30a84 with identifier: YF11400
2025-12-05 17:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55a4b08-5ea2-59c9-8935-984e5cb30a84 with scrape type 1
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_2ef28caa5e2c7878359f0ed8a8fc45b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_2ef28caa5e2c7878359f0ed8a8fc45b4.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_4340b56ad92e32e979efc32eeee362b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4340b56ad92e32e979efc32eeee362b2.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_0d459a0e3b70b39373377e360cb32d4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0d459a0e3b70b39373377e360cb32d4c.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_489e97a5bd564271fbbf5a11eefed7df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_489e97a5bd564271fbbf5a11eefed7df.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_2f316d3926da618cb5d8938856d206d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_2f316d3926da618cb5d8938856d206d3.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_ef40ef2bdc6398a5ab1d9fb57cc4ca5d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ef40ef2bdc6398a5ab1d9fb57cc4ca5d.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_fbc00be8ae5ef80cb6b2a0c2bb7aee11.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fbc00be8ae5ef80cb6b2a0c2bb7aee11.jpg not downloaded yet
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_b04c03261a2247ff3b4a33c024c8dba4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b04c03261a2247ff3b4a33c024c8dba4.jpg not downloaded yet
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5843a10>
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_f24f8093053d02dbe6573e741a4c8d76.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f24f8093053d02dbe6573e741a4c8d76.jpg saved to cache
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b25950>
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_e5308e1ffd81880059135aba8323d86a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_e5308e1ffd81880059135aba8323d86a.jpg saved to cache
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_c5fed4c70115362b25ce5926ca63b240.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c5fed4c70115362b25ce5926ca63b240.jpg not downloaded yet
2025-12-05 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_8ef6f40d44339e278b154fcb226f55fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ef6f40d44339e278b154fcb226f55fb.jpg not downloaded yet
2025-12-05 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_512539ec3347a50908ef7f58346d1276.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_f5ef4fe8a6309410a8af2fd0169f0efc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_f5ef4fe8a6309410a8af2fd0169f0efc.jpg not downloaded yet
2025-12-05 17:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b77322-3746-5b7f-8e88-85012bb3f7a3 with identifier: JA37182
2025-12-05 17:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b77322-3746-5b7f-8e88-85012bb3f7a3 with scrape type 1
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e9b77322-3746-5b7f-8e88-85012bb3f7a3
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_cc8029924df3f2e520451a41ee3d2550.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_b24e970a756f4396093112dd6e6276a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_79c96845962c406574c64fa128c96b9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_b33d81366ae1999aea516190a17709ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_5741062ca0e1a247bccfa56456bac3e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_053a71ccf4d40964aaaad27816f56f6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_6974dca0049ce52776b00e7b758c9fde.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg already downloaded
2025-12-05 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_1f85998d68f5e5e0083f78d963f1406a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_855eb4b440e87b795d13749234240523.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_96c3e8b09c55edb0500048c8e7787384.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg already downloaded
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fae%252Fb3aea6c1276ed2bd994af9b684e1f544%252Fpa%252FJA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png already downloaded
2025-12-05 17:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9b77322-3746-5b7f-8e88-85012bb3f7a3, identifier: JA37182
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_54af58a69f8d7a063c5625704f87ae4e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_54af58a69f8d7a063c5625704f87ae4e.jpg not downloaded yet
2025-12-05 17:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9b77322-3746-5b7f-8e88-85012bb3f7a3 with identifier: JA37182
2025-12-05 17:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9b77322-3746-5b7f-8e88-85012bb3f7a3 with identifier: JA37182
2025-12-05 17:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 7767, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ja37182', 'expiration_date': '2025-12-06t16:56:40z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, miramas', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'e9b77322-3746-5b7f-8e88-85012bb3f7a3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59174}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62003}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51517}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2466227}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 46079}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58895}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61298}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57174}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2419759}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65219}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 75822}], 'current_year_diff': 2, 'age_in_months': 25, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 7767}
Failed validating None in schema:
False
On instance:
{'age_in_months': 25,
'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:56:40z',
'fuel_type': 'petrol',
'id': 'e9b77322-3746-5b7f-8e88-85012bb3f7a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ja37182',
'listing': 'auction',
'location': 'fr, miramas',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 7767,
'odometer_in_km': 7767,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466227,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419759,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 75822,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2023}
2025-12-05 17:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e9b77322-3746-5b7f-8e88-85012bb3f7a3 spider: auto1.fr
2025-12-05 17:02:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e9b77322-3746-5b7f-8e88-85012bb3f7a3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 7767, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ja37182', 'expiration_date': '2025-12-06t16:56:40z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg', 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, miramas', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'e9b77322-3746-5b7f-8e88-85012bb3f7a3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59174}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62003}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51517}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2466227}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 46079}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58895}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61298}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57174}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2419759}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65219}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 75822}], 'current_year_diff': 2, 'age_in_months': 25, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 7767}
Failed validating None in schema:
False
On instance:
{'age_in_months': 25,
'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:56:40z',
'fuel_type': 'petrol',
'id': 'e9b77322-3746-5b7f-8e88-85012bb3f7a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ja37182',
'listing': 'auction',
'location': 'fr, miramas',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 7767,
'odometer_in_km': 7767,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466227,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419759,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 75822,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:56:40Z',
'fuel_type': 'petrol',
'id': 'e9b77322-3746-5b7f-8e88-85012bb3f7a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA37182',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'Peugeot',
'model': '308',
'odometer': 7767,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg',
'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_cc8029924df3f2e520451a41ee3d2550.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b24e970a756f4396093112dd6e6276a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_79c96845962c406574c64fa128c96b9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_b33d81366ae1999aea516190a17709ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_5741062ca0e1a247bccfa56456bac3e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466227,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_053a71ccf4d40964aaaad27816f56f6d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_6974dca0049ce52776b00e7b758c9fde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_21496bde65105c9a4b4bba24f4b6e4b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e56dd39b10b932b0a5fcb3b48fe4a8e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_ec6ddae7140556de04cab80d6e8d42ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419759,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_e31e4cfb73bd0df76d2f34d4a81dcd96.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_1f85998d68f5e5e0083f78d963f1406a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_855eb4b440e87b795d13749234240523.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_96c3e8b09c55edb0500048c8e7787384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_0a896e8048a4e5c13f6cb19c14a16fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b77322-3746-5b7f-8e88-85012bb3f7a3/e9b77322-3746-5b7f-8e88-85012bb3f7a3_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 75822,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/ae/b3aea6c1276ed2bd994af9b684e1f544/pa/JA37182_3cfbd786e1d0a41318cca6b661d2cd7c.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2023}
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA37182%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [auto1.fr] INFO: Saving data for JA37182: {'created_time': 1764954150.518173, 'last_price_update_time': 1764954150.518185, 'auction_closing_time': 1765040200.0}
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA37182') HTTP/1.1" 204 0
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_ecf7f8e25d6040aaf7b34d004b7318b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ecf7f8e25d6040aaf7b34d004b7318b8.jpg not downloaded yet
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_97509d2707ea4b932115eb4ad02f608c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_8ace67e5be0704e19e27d76bc7fc3f13.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ace67e5be0704e19e27d76bc7fc3f13.jpg not downloaded yet
2025-12-05 17:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL29839> (referer: https://www.auto1.com/v1/car-details-view/KL29839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df6010>
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg saved to cache
2025-12-05 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e7b50>
2025-12-05 17:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_512539ec3347a50908ef7f58346d1276.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_512539ec3347a50908ef7f58346d1276.jpg saved to cache
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_ef6741b1220762fec61d6952935c67a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ef6741b1220762fec61d6952935c67a9.jpg not downloaded yet
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_4ec88f3c3ba1b10a4d60c5e0d7cff3cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4ec88f3c3ba1b10a4d60c5e0d7cff3cb.jpg not downloaded yet
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_74ddea0e8b538778a347675b589bbab2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_74ddea0e8b538778a347675b589bbab2.jpg not downloaded yet
2025-12-05 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA63392> (referer: https://www.auto1.com/v1/car-details-view/FA63392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_29f0f46d25c20d97eff3f23b0a83c2bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_29f0f46d25c20d97eff3f23b0a83c2bb.jpg not downloaded yet
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_0a65d38a9e6d5319c813316a6d0beeea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_0a65d38a9e6d5319c813316a6d0beeea.jpg not downloaded yet
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a738d0>
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg saved to cache
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cba2d0>
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_97509d2707ea4b932115eb4ad02f608c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_97509d2707ea4b932115eb4ad02f608c.jpg saved to cache
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 with identifier: KL29839
2025-12-05 17:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 with scrape type 2
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 with scrape type 2
2025-12-05 17:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78, identifier: KL29839
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_7c0167771ce089d6938c770d41475d24.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_7c0167771ce089d6938c770d41475d24.jpg not downloaded yet
2025-12-05 17:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 with identifier: KL29839
2025-12-05 17:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 with identifier: KL29839
2025-12-05 17:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 116695, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl29839', 'expiration_date': '2025-12-06t16:19:11z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '8b67fddc-9c4a-5ecf-ad19-a22bdf758b78', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 116695}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:19:11z',
'fuel_type': 'petrol',
'id': '8b67fddc-9c4a-5ecf-ad19-a22bdf758b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl29839',
'listing': 'auction',
'location': 'fr, chartres de bretagne',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 116695,
'odometer_in_km': 116695,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-02',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2017}
2025-12-05 17:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 spider: auto1.fr
2025-12-05 17:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8b67fddc-9c4a-5ecf-ad19-a22bdf758b78 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 116695, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl29839', 'expiration_date': '2025-12-06t16:19:11z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '8b67fddc-9c4a-5ecf-ad19-a22bdf758b78', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 116695}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:19:11z',
'fuel_type': 'petrol',
'id': '8b67fddc-9c4a-5ecf-ad19-a22bdf758b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl29839',
'listing': 'auction',
'location': 'fr, chartres de bretagne',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 116695,
'odometer_in_km': 116695,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-02',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:19:11Z',
'fuel_type': 'petrol',
'id': '8b67fddc-9c4a-5ecf-ad19-a22bdf758b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL29839',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Citroen',
'model': 'C3',
'odometer': 116695,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2017}
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL29839%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [auto1.fr] INFO: Saving data for KL29839: {'auction_closing_time': 1765037951.0, 'created_time': 1763373766.774414, 'last_price_update_time': 1764954152.028474}
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL29839') HTTP/1.1" 204 0
2025-12-05 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_1e6d1e9595f3b901c10dd42293fc178d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_a17475942019e39502152aeb72eb2e1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_a17475942019e39502152aeb72eb2e1f.jpg not downloaded yet
2025-12-05 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_1d649f80f4c31f5d0bd8ad047eebb982.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1d649f80f4c31f5d0bd8ad047eebb982.jpg not downloaded yet
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_37820a07d76f07ea8d060439b8c7b78b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_37820a07d76f07ea8d060439b8c7b78b.jpg not downloaded yet
2025-12-05 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_eda6d3cb996e565e1b2a5c91f23c946f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_eda6d3cb996e565e1b2a5c91f23c946f.jpg not downloaded yet
2025-12-05 17:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d153ce-fae2-5359-93b4-d08df77e9696 with identifier: FA63392
2025-12-05 17:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d153ce-fae2-5359-93b4-d08df77e9696 with scrape type 2
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d153ce-fae2-5359-93b4-d08df77e9696 with scrape type 2
2025-12-05 17:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8d153ce-fae2-5359-93b4-d08df77e9696, identifier: FA63392
2025-12-05 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_c08f22e98003ff313b5951e4d07fc980.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_fa8fa532773ec8dcc5ceb38196ba3bc4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fa8fa532773ec8dcc5ceb38196ba3bc4.jpg not downloaded yet
2025-12-05 17:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8d153ce-fae2-5359-93b4-d08df77e9696 with identifier: FA63392
2025-12-05 17:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8d153ce-fae2-5359-93b4-d08df77e9696 with identifier: FA63392
2025-12-05 17:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8d153ce-fae2-5359-93b4-d08df77e9696 with identifier: FA63392 to the API
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FA63392>
{'auction_title': '',
'c_o_2_emission_value': 36,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 252,
'expiration_date': '2025-12-06T16:07:42Z',
'fuel_type': 'hybrid',
'id': 'f8d153ce-fae2-5359-93b4-d08df77e9696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA63392',
'listing': 'auction',
'location': 'FR, Aix-en-Provence',
'make': 'BMW',
'model': '3er',
'odometer': 44125,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 330e xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2021}
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA63392%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [auto1.fr] INFO: Saving data for FA63392: {'auction_closing_time': 1765037262.0, 'created_time': 1764867649.511958, 'last_price_update_time': 1764954152.68772}
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA63392') HTTP/1.1" 204 0
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_1fbed5568e8fe187382f272f2bf4fe78.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1fbed5568e8fe187382f272f2bf4fe78.jpg not downloaded yet
2025-12-05 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_2ef28caa5e2c7878359f0ed8a8fc45b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_bdc93b4273061c29dad81fba0abdd98d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_bdc93b4273061c29dad81fba0abdd98d.jpg not downloaded yet
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b275d0>
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_1e6d1e9595f3b901c10dd42293fc178d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_1e6d1e9595f3b901c10dd42293fc178d.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e64550>
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c9a650>
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_38d06bee002dbdeda16c159706adf9ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_b831399e58ebeeed25c7c37ac27ad6de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b831399e58ebeeed25c7c37ac27ad6de.jpg not downloaded yet
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_30f1de6e85839592f1ddad394f9e4f02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_30f1de6e85839592f1ddad394f9e4f02.jpg not downloaded yet
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f34d0>
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_c08f22e98003ff313b5951e4d07fc980.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_c08f22e98003ff313b5951e4d07fc980.jpg saved to cache
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b04c03261a2247ff3b4a33c024c8dba4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_213d27419084364bc56e395132775bde.png%27 HTTP/1.1" 200 None
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_213d27419084364bc56e395132775bde.png not downloaded yet
2025-12-05 17:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_c50755185c10e059a2704b52d8674a07.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c50755185c10e059a2704b52d8674a07.jpg not downloaded yet
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_424e0bf6b930f91a381bf95c8bd183ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_54af58a69f8d7a063c5625704f87ae4e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f05150>
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_2ef28caa5e2c7878359f0ed8a8fc45b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_2ef28caa5e2c7878359f0ed8a8fc45b4.jpg saved to cache
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e37750>
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_d1a61065626602847fb203c5788802b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg saved to cache
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df44d0>
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_ca96992bd45cd71761ec266de0623732.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg saved to cache
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_74ddea0e8b538778a347675b589bbab2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_757d0cd74115d01157fd5eafa5f4aeeb.png%27 HTTP/1.1" 200 None
2025-12-05 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_757d0cd74115d01157fd5eafa5f4aeeb.png not downloaded yet
2025-12-05 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_d3bb1e3e168eb48061dc7b1f2def24b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f7790>
2025-12-05 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_b04c03261a2247ff3b4a33c024c8dba4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b04c03261a2247ff3b4a33c024c8dba4.jpg saved to cache
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eca190>
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_fc2854e14031dc877630db8843e8aa14.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg saved to cache
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c784ab10>
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_424e0bf6b930f91a381bf95c8bd183ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_424e0bf6b930f91a381bf95c8bd183ed.jpg saved to cache
2025-12-05 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e4a8d0>
2025-12-05 17:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_54af58a69f8d7a063c5625704f87ae4e.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_54af58a69f8d7a063c5625704f87ae4e.jpg saved to cache
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1d649f80f4c31f5d0bd8ad047eebb982.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_7c0167771ce089d6938c770d41475d24.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_37820a07d76f07ea8d060439b8c7b78b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59e7e90>
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_74ddea0e8b538778a347675b589bbab2.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_74ddea0e8b538778a347675b589bbab2.jpg saved to cache
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f5550>
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_d3bb1e3e168eb48061dc7b1f2def24b8.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_d3bb1e3e168eb48061dc7b1f2def24b8.jpg saved to cache
2025-12-05 17:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da2bd0>
2025-12-05 17:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_1d649f80f4c31f5d0bd8ad047eebb982.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1d649f80f4c31f5d0bd8ad047eebb982.jpg saved to cache
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4efc8d0>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_7c0167771ce089d6938c770d41475d24.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_7c0167771ce089d6938c770d41475d24.jpg saved to cache
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cfa750>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_37820a07d76f07ea8d060439b8c7b78b.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_37820a07d76f07ea8d060439b8c7b78b.jpg saved to cache
2025-12-05 17:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_757d0cd74115d01157fd5eafa5f4aeeb.png> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c50755185c10e059a2704b52d8674a07.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_213d27419084364bc56e395132775bde.png> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c5fed4c70115362b25ce5926ca63b240.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ace67e5be0704e19e27d76bc7fc3f13.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_f5ef4fe8a6309410a8af2fd0169f0efc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_0a65d38a9e6d5319c813316a6d0beeea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fa8fa532773ec8dcc5ceb38196ba3bc4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_30f1de6e85839592f1ddad394f9e4f02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b831399e58ebeeed25c7c37ac27ad6de.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_bdc93b4273061c29dad81fba0abdd98d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ef6741b1220762fec61d6952935c67a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_eda6d3cb996e565e1b2a5c91f23c946f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:37 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:02:37 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:02:37 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:02:37 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ff050>
2025-12-05 17:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_15.png HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_757d0cd74115d01157fd5eafa5f4aeeb.png') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_757d0cd74115d01157fd5eafa5f4aeeb.png saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a4f850>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_c50755185c10e059a2704b52d8674a07.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c50755185c10e059a2704b52d8674a07.jpg saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:38 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:02:38 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:02:38 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:02:38 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5893850>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_15.png HTTP/1.1" 201 0
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_213d27419084364bc56e395132775bde.png') HTTP/1.1" 204 0
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_213d27419084364bc56e395132775bde.png saved to cache
2025-12-05 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ef6f40d44339e278b154fcb226f55fb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5770bd0>
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_c5fed4c70115362b25ce5926ca63b240.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c5fed4c70115362b25ce5926ca63b240.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d47b50>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_8ace67e5be0704e19e27d76bc7fc3f13.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ace67e5be0704e19e27d76bc7fc3f13.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e23810>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_f5ef4fe8a6309410a8af2fd0169f0efc.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_f5ef4fe8a6309410a8af2fd0169f0efc.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58290d0>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_0a65d38a9e6d5319c813316a6d0beeea.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_0a65d38a9e6d5319c813316a6d0beeea.jpg saved to cache
2025-12-05 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b1ad10>
2025-12-05 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_fa8fa532773ec8dcc5ceb38196ba3bc4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fa8fa532773ec8dcc5ceb38196ba3bc4.jpg saved to cache
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7919010>
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_30f1de6e85839592f1ddad394f9e4f02.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_30f1de6e85839592f1ddad394f9e4f02.jpg saved to cache
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cbc90>
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_b831399e58ebeeed25c7c37ac27ad6de.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b831399e58ebeeed25c7c37ac27ad6de.jpg saved to cache
2025-12-05 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0c690>
2025-12-05 17:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_bdc93b4273061c29dad81fba0abdd98d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_bdc93b4273061c29dad81fba0abdd98d.jpg saved to cache
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a86490>
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_ef6741b1220762fec61d6952935c67a9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ef6741b1220762fec61d6952935c67a9.jpg saved to cache
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a94f10>
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_eda6d3cb996e565e1b2a5c91f23c946f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_eda6d3cb996e565e1b2a5c91f23c946f.jpg saved to cache
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f2e7d0>
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_8ef6f40d44339e278b154fcb226f55fb.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ef6f40d44339e278b154fcb226f55fb.jpg saved to cache
2025-12-05 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4ec88f3c3ba1b10a4d60c5e0d7cff3cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_29f0f46d25c20d97eff3f23b0a83c2bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1fbed5568e8fe187382f272f2bf4fe78.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_a17475942019e39502152aeb72eb2e1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ecf7f8e25d6040aaf7b34d004b7318b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fbc00be8ae5ef80cb6b2a0c2bb7aee11.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_2f316d3926da618cb5d8938856d206d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_02c367dfe19c43d27a3a1ff3004c1d19.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd30d0>
2025-12-05 17:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_4ec88f3c3ba1b10a4d60c5e0d7cff3cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4ec88f3c3ba1b10a4d60c5e0d7cff3cb.jpg saved to cache
2025-12-05 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f727df05791983140f5a600cd413d7e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d66150>
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_29f0f46d25c20d97eff3f23b0a83c2bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_29f0f46d25c20d97eff3f23b0a83c2bb.jpg saved to cache
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ee3d0>
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_1fbed5568e8fe187382f272f2bf4fe78.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1fbed5568e8fe187382f272f2bf4fe78.jpg saved to cache
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a8b090>
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_a17475942019e39502152aeb72eb2e1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_a17475942019e39502152aeb72eb2e1f.jpg saved to cache
2025-12-05 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0d459a0e3b70b39373377e360cb32d4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ef40ef2bdc6398a5ab1d9fb57cc4ca5d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579e2d0>
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_ecf7f8e25d6040aaf7b34d004b7318b8.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ecf7f8e25d6040aaf7b34d004b7318b8.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59e5550>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_fbc00be8ae5ef80cb6b2a0c2bb7aee11.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fbc00be8ae5ef80cb6b2a0c2bb7aee11.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c788f690>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_2f316d3926da618cb5d8938856d206d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_2f316d3926da618cb5d8938856d206d3.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5993690>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_02c367dfe19c43d27a3a1ff3004c1d19.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_02c367dfe19c43d27a3a1ff3004c1d19.jpg saved to cache
2025-12-05 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b096d0>
2025-12-05 17:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f3010>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_f727df05791983140f5a600cd413d7e1.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f727df05791983140f5a600cd413d7e1.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c996d0>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg saved to cache
2025-12-05 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU63041> (referer: https://www.auto1.com/v1/car-details-view/ZU63041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e75850>
2025-12-05 17:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_0d459a0e3b70b39373377e360cb32d4c.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0d459a0e3b70b39373377e360cb32d4c.jpg saved to cache
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e75a10>
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_ef40ef2bdc6398a5ab1d9fb57cc4ca5d.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ef40ef2bdc6398a5ab1d9fb57cc4ca5d.jpg saved to cache
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d61050>
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg saved to cache
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_81938a1cda0c086b51886670c52a4547.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_a5788c5f28d7b7998c993a5608613da5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0af20f069d1352074fd17c11a36eecf4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d50d6f11-aef5-5b3c-92ce-a411314cf839 with identifier: ZU63041
2025-12-05 17:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d50d6f11-aef5-5b3c-92ce-a411314cf839 with scrape type 1
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d50d6f11-aef5-5b3c-92ce-a411314cf839
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_91b4bd704938e6f63876612fb14588d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_1ee68ab9f2478731769e244accfd01dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_b3699d047802ac113d13b265d6b22559.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_f2b78cb40caa45451af8ace554eb7974.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_0bdfbcd52697326219d8492f66913971.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_387f5cc926d5640269c7a0a299a86c14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg already downloaded
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4d%252Fe34de84bc468486c4e04e7f521b995ad%252Fpa%252FZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg already downloaded
2025-12-05 17:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d50d6f11-aef5-5b3c-92ce-a411314cf839, identifier: ZU63041
2025-12-05 17:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d50d6f11-aef5-5b3c-92ce-a411314cf839 with identifier: ZU63041
2025-12-05 17:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d50d6f11-aef5-5b3c-92ce-a411314cf839 with identifier: ZU63041
2025-12-05 17:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'automatic', 'odometer': 20905, 'odometer_reading_unit': 'km', 'registration_date': '2023-03-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu63041', 'expiration_date': '2025-12-06t16:14:51z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': 'd50d6f11-aef5-5b3c-92ce-a411314cf839', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53514}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62991}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49085}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 46999}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61900}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64844}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58255}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77528}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54513}], 'current_year_diff': 2, 'age_in_months': 33, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 20905}
Failed validating None in schema:
False
On instance:
{'age_in_months': 33,
'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:14:51z',
'fuel_type': 'petrol',
'id': 'd50d6f11-aef5-5b3c-92ce-a411314cf839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu63041',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'citroen',
'make_model': 'citroen c4',
'model': 'c4',
'odometer': 20905,
'odometer_in_km': 20905,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-01',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 1.2 puretech c-series',
'transmission': 'automatic',
'trim': 'c-series',
'year': 2023}
2025-12-05 17:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d50d6f11-aef5-5b3c-92ce-a411314cf839 spider: auto1.fr
2025-12-05 17:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d50d6f11-aef5-5b3c-92ce-a411314cf839 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'automatic', 'odometer': 20905, 'odometer_reading_unit': 'km', 'registration_date': '2023-03-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu63041', 'expiration_date': '2025-12-06t16:14:51z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg', 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': 'd50d6f11-aef5-5b3c-92ce-a411314cf839', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53514}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62991}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49085}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 46999}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61900}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64844}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58255}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77528}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54513}], 'current_year_diff': 2, 'age_in_months': 33, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 20905}
Failed validating None in schema:
False
On instance:
{'age_in_months': 33,
'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:14:51z',
'fuel_type': 'petrol',
'id': 'd50d6f11-aef5-5b3c-92ce-a411314cf839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu63041',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'citroen',
'make_model': 'citroen c4',
'model': 'c4',
'odometer': 20905,
'odometer_in_km': 20905,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-01',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 1.2 puretech c-series',
'transmission': 'automatic',
'trim': 'c-series',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:14:51Z',
'fuel_type': 'petrol',
'id': 'd50d6f11-aef5-5b3c-92ce-a411314cf839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU63041',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Citroen',
'model': 'C4',
'odometer': 20905,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg',
'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_3c86c7d20a28f160364c2bb619b5070a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_88e32b4f8fccd908b51d1d839c42fb4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_91b4bd704938e6f63876612fb14588d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_1ee68ab9f2478731769e244accfd01dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_b3699d047802ac113d13b265d6b22559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f2b78cb40caa45451af8ace554eb7974.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_bb81b8c872b8a4bc7dc586492195c200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_89b53aaeed0559bb9cb80a15116959fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_4a84767d20cc3bdc0442e84602ae5582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_f775cf4127e04bee5ad4c7eee0b68054.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_0bdfbcd52697326219d8492f66913971.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_82bfc4b561cebddc4378f1576b4dac5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_ffc652378453fd9d5e5fafd26ba597a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_387f5cc926d5640269c7a0a299a86c14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_d9b25fa0aa5d39bf5c4e85625b376f62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d50d6f11-aef5-5b3c-92ce-a411314cf839/d50d6f11-aef5-5b3c-92ce-a411314cf839_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/4d/e34de84bc468486c4e04e7f521b995ad/pa/ZU63041_5e21dbb34cb3610426d45a3e8ea77bc1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.2 PureTech C-Series',
'transmission': 'automatic',
'trim': 'C-Series',
'year': 2023}
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU63041%27 HTTP/1.1" 200 None
2025-12-05 17:02:47 [auto1.fr] INFO: Saving data for ZU63041: {'created_time': 1764954167.596343, 'last_price_update_time': 1764954167.596353, 'auction_closing_time': 1765037691.0}
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZU63041') HTTP/1.1" 204 0
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_e8b3a81d253e4778e8f01ae13418fbec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB99000> (referer: https://www.auto1.com/v1/car-details-view/CB99000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_aff4cad4f144303a699da65f96618956.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59e6110>
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg saved to cache
2025-12-05 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5812b90>
2025-12-05 17:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_81938a1cda0c086b51886670c52a4547.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_81938a1cda0c086b51886670c52a4547.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a65090>
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_a5788c5f28d7b7998c993a5608613da5.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_a5788c5f28d7b7998c993a5608613da5.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59acf10>
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3c%252F253c01be0068428b3590ada11bc78242%252Fpa%252FTZ95373_0af20f069d1352074fd17c11a36eecf4.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0af20f069d1352074fd17c11a36eecf4.jpg saved to cache
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c
2025-12-05 17:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 583f3a1a-fa34-576f-b8aa-75d1ec6f797c, skipping ID generation
2025-12-05 17:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c with scrape type 1
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c from tracking dictionaries
2025-12-05 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 583f3a1a-fa34-576f-b8aa-75d1ec6f797c sending to next pipeline
2025-12-05 17:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 583f3a1a-fa34-576f-b8aa-75d1ec6f797c, identifier: TZ95373
2025-12-05 17:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 583f3a1a-fa34-576f-b8aa-75d1ec6f797c with identifier: TZ95373
2025-12-05 17:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 583f3a1a-fa34-576f-b8aa-75d1ec6f797c with identifier: TZ95373
2025-12-05 17:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 583f3a1a-fa34-576f-b8aa-75d1ec6f797c with identifier: TZ95373 to the API
2025-12-05 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0af20f069d1352074fd17c11a36eecf4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 129,
'expiration_date': '2025-12-06T16:39:08Z',
'fuel_type': 'petrol',
'id': '583f3a1a-fa34-576f-b8aa-75d1ec6f797c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ95373',
'listing': 'auction',
'location': 'FR, Martigues',
'make': 'Volvo',
'model': 'XC40',
'odometer': 93298,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3127558,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_424e0bf6b930f91a381bf95c8bd183ed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ed92150eb6b0f135609d0eb83a2e40b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3066112,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_d3bb1e3e168eb48061dc7b1f2def24b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_81938a1cda0c086b51886670c52a4547.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_858f6f937606a274a1ea369184eaf8aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0af20f069d1352074fd17c11a36eecf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_dd5f23d1087ca839d1d15ac0d32883f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f24f8093053d02dbe6573e741a4c8d76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_512539ec3347a50908ef7f58346d1276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_e5308e1ffd81880059135aba8323d86a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_a5788c5f28d7b7998c993a5608613da5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_97509d2707ea4b932115eb4ad02f608c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_1e6d1e9595f3b901c10dd42293fc178d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_f727df05791983140f5a600cd413d7e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_0d459a0e3b70b39373377e360cb32d4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_583f3a1a-fa34-576f-b8aa-75d1ec6f797c/583f3a1a-fa34-576f-b8aa-75d1ec6f797c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/3c/253c01be0068428b3590ada11bc78242/pa/TZ95373_ef40ef2bdc6398a5ab1d9fb57cc4ca5d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T2 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2020}
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ95373%27 HTTP/1.1" 200 None
2025-12-05 17:02:49 [auto1.fr] INFO: Saving data for TZ95373: {'created_time': 1764954169.159667, 'last_price_update_time': 1764954169.159677, 'auction_closing_time': 1765039148.0}
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ95373') HTTP/1.1" 204 0
2025-12-05 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC94844> (referer: https://www.auto1.com/v1/car-details-view/UC94844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC62498> (referer: https://www.auto1.com/v1/car-details-view/NC62498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN69075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a89650>
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_e8b3a81d253e4778e8f01ae13418fbec.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_e8b3a81d253e4778e8f01ae13418fbec.jpg saved to cache
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5988710>
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_584276307a0fd8d9f6186660938e28aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg saved to cache
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c599bc50>
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_618f596948b62481a89d8011af4d3052.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg saved to cache
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f4883f-6dac-52c3-afb2-1296df2023fe with identifier: CB99000
2025-12-05 17:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f4883f-6dac-52c3-afb2-1296df2023fe with scrape type 2
2025-12-05 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f4883f-6dac-52c3-afb2-1296df2023fe with scrape type 2
2025-12-05 17:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0f4883f-6dac-52c3-afb2-1296df2023fe, identifier: CB99000
2025-12-05 17:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd0710>
2025-12-05 17:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_aff4cad4f144303a699da65f96618956.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_aff4cad4f144303a699da65f96618956.jpg saved to cache
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0f4883f-6dac-52c3-afb2-1296df2023fe with identifier: CB99000
2025-12-05 17:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0f4883f-6dac-52c3-afb2-1296df2023fe with identifier: CB99000
2025-12-05 17:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0f4883f-6dac-52c3-afb2-1296df2023fe with identifier: CB99000 to the API
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB99000>
{'auction_title': '',
'c_o_2_emission_value': 86,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2025-12-06T16:02:04Z',
'fuel_type': 'diesel',
'id': 'a0f4883f-6dac-52c3-afb2-1296df2023fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB99000',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Citroen',
'model': 'C3',
'odometer': 96148,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.5 Blue-HDi Feel Business',
'transmission': 'manual',
'trim': 'Feel Business',
'year': 2019}
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB99000%27 HTTP/1.1" 200 None
2025-12-05 17:02:51 [auto1.fr] INFO: Saving data for CB99000: {'auction_closing_time': 1765036924.0, 'created_time': 1764748847.69225, 'last_price_update_time': 1764954171.379391}
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB99000') HTTP/1.1" 204 0
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_baa19ff50ebb68ce2d64f452db34f3a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX15760> (referer: https://www.auto1.com/v1/car-details-view/XX15760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD60293> (referer: https://www.auto1.com/v1/car-details-view/RD60293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH21838> (referer: https://www.auto1.com/v1/car-details-view/PH21838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fb33232-59b9-56d2-a42f-b17beb93676b with identifier: UC94844
2025-12-05 17:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fb33232-59b9-56d2-a42f-b17beb93676b with scrape type 2
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fb33232-59b9-56d2-a42f-b17beb93676b with scrape type 2
2025-12-05 17:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4fb33232-59b9-56d2-a42f-b17beb93676b, identifier: UC94844
2025-12-05 17:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35e79ad3-c397-5ac6-8039-c3f695420539 with identifier: NC62498
2025-12-05 17:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35e79ad3-c397-5ac6-8039-c3f695420539 with scrape type 2
2025-12-05 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35e79ad3-c397-5ac6-8039-c3f695420539 with scrape type 2
2025-12-05 17:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35e79ad3-c397-5ac6-8039-c3f695420539, identifier: NC62498
2025-12-05 17:02:51 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4fb33232-59b9-56d2-a42f-b17beb93676b with identifier: UC94844
2025-12-05 17:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4fb33232-59b9-56d2-a42f-b17beb93676b with identifier: UC94844
2025-12-05 17:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 64638, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc94844', 'expiration_date': '2025-12-06t16:55:30z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 121, 'id': '4fb33232-59b9-56d2-a42f-b17beb93676b', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 64638}
Failed validating None in schema:
False
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:55:30z',
'fuel_type': 'petrol',
'id': '4fb33232-59b9-56d2-a42f-b17beb93676b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc94844',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 64638,
'odometer_in_km': 64638,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2022}
2025-12-05 17:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4fb33232-59b9-56d2-a42f-b17beb93676b spider: auto1.fr
2025-12-05 17:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4fb33232-59b9-56d2-a42f-b17beb93676b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 64638, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc94844', 'expiration_date': '2025-12-06t16:55:30z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 121, 'id': '4fb33232-59b9-56d2-a42f-b17beb93676b', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 64638}
Failed validating None in schema:
False
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:55:30z',
'fuel_type': 'petrol',
'id': '4fb33232-59b9-56d2-a42f-b17beb93676b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc94844',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 64638,
'odometer_in_km': 64638,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:55:30Z',
'fuel_type': 'petrol',
'id': '4fb33232-59b9-56d2-a42f-b17beb93676b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC94844',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '208',
'odometer': 64638,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2022}
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC94844%27 HTTP/1.1" 200 None
2025-12-05 17:02:51 [auto1.fr] INFO: Saving data for UC94844: {'auction_closing_time': 1765040130.0, 'created_time': 1764004521.611672, 'last_price_update_time': 1764954171.842423}
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC94844') HTTP/1.1" 204 0
2025-12-05 17:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35e79ad3-c397-5ac6-8039-c3f695420539 with identifier: NC62498
2025-12-05 17:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35e79ad3-c397-5ac6-8039-c3f695420539 with identifier: NC62498
2025-12-05 17:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35e79ad3-c397-5ac6-8039-c3f695420539 with identifier: NC62498 to the API
2025-12-05 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%2735e79ad3-c397-5ac6-8039-c3f695420539%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [crawlers.pipelines.post_to_api] ERROR: auto1.fr, item_id 35e79ad3-c397-5ac6-8039-c3f695420539: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 17:02:51 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2025-12-05 17:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC62498>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:02:03Z',
'fuel_type': 'petrol',
'id': '35e79ad3-c397-5ac6-8039-c3f695420539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC62498',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 126634,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.5 TSI ACT',
'transmission': 'manual',
'trim': '',
'year': 2017}
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC62498%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Saving data for NC62498: {'auction_closing_time': 1765036923.0, 'created_time': 1764263227.19473, 'last_price_update_time': 1764954172.38381}
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC62498') HTTP/1.1" 204 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: CY34034
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY34034%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for CY34034: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: NG48818
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG48818%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for NG48818: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: PC84706
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC84706%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for PC84706: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: MN66581
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN66581%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for MN66581: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: ED08326
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED08326%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for ED08326: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: WB61551
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB61551%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for WB61551: 2
2025-12-05 17:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW96531> (referer: https://www.auto1.com/v1/car-details-view/JW96531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: VV21024
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV21024%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for VV21024: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: PS71805
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS71805%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for PS71805: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: SS97916
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS97916%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for SS97916: 0
2025-12-05 17:02:52 [auto1.fr] INFO: Found listing with ID: UZ91809
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ91809%27 HTTP/1.1" 200 None
2025-12-05 17:02:52 [auto1.fr] INFO: Scrape type for UZ91809: 2
2025-12-05 17:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4340b56ad92e32e979efc32eeee362b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbb690>
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F77%252F1a771f56d9d2d9cfbad72ffaf7c6dd34%252Fpa%252FCF79780_baa19ff50ebb68ce2d64f452db34f3a9.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_baa19ff50ebb68ce2d64f452db34f3a9.jpg saved to cache
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10
2025-12-05 17:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db0c4a37-a6ae-50dd-bc9f-7727565ebb10, skipping ID generation
2025-12-05 17:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10 with scrape type 1
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db0c4a37-a6ae-50dd-bc9f-7727565ebb10 from tracking dictionaries
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db0c4a37-a6ae-50dd-bc9f-7727565ebb10 sending to next pipeline
2025-12-05 17:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db0c4a37-a6ae-50dd-bc9f-7727565ebb10, identifier: CF79780
2025-12-05 17:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45df3874-d681-5c6b-a6cf-c7e354da01d5 with identifier: XX15760
2025-12-05 17:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45df3874-d681-5c6b-a6cf-c7e354da01d5 with scrape type 2
2025-12-05 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45df3874-d681-5c6b-a6cf-c7e354da01d5 with scrape type 2
2025-12-05 17:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 45df3874-d681-5c6b-a6cf-c7e354da01d5, identifier: XX15760
2025-12-05 17:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 812d5fc4-2088-53ce-a117-7f75739dbf9c with identifier: RD60293
2025-12-05 17:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 812d5fc4-2088-53ce-a117-7f75739dbf9c with scrape type 2
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 812d5fc4-2088-53ce-a117-7f75739dbf9c with scrape type 2
2025-12-05 17:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 812d5fc4-2088-53ce-a117-7f75739dbf9c, identifier: RD60293
2025-12-05 17:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f44a46-6ea4-5889-81b5-2dcd920950c9 with identifier: PH21838
2025-12-05 17:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f44a46-6ea4-5889-81b5-2dcd920950c9 with scrape type 2
2025-12-05 17:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f44a46-6ea4-5889-81b5-2dcd920950c9 with scrape type 2
2025-12-05 17:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26f44a46-6ea4-5889-81b5-2dcd920950c9, identifier: PH21838
2025-12-05 17:02:53 [auto1.fr] INFO: Found listing with ID: JS58927
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS58927%27 HTTP/1.1" 200 None
2025-12-05 17:02:53 [auto1.fr] INFO: Scrape type for JS58927: 0
2025-12-05 17:02:53 [auto1.fr] INFO: Found listing with ID: WY67356
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY67356%27 HTTP/1.1" 200 None
2025-12-05 17:02:53 [auto1.fr] INFO: Scrape type for WY67356: 2
2025-12-05 17:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db0c4a37-a6ae-50dd-bc9f-7727565ebb10 with identifier: CF79780
2025-12-05 17:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db0c4a37-a6ae-50dd-bc9f-7727565ebb10 with identifier: CF79780
2025-12-05 17:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
2025-12-05 17:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: db0c4a37-a6ae-50dd-bc9f-7727565ebb10 spider: auto1.fr
2025-12-05 17:02:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: db0c4a37-a6ae-50dd-bc9f-7727565ebb10 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 160,
'expiration_date': '2025-12-06T16:36:25Z',
'fuel_type': 'diesel',
'id': 'db0c4a37-a6ae-50dd-bc9f-7727565ebb10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF79780',
'listing': 'auction',
'location': 'FR',
'make': 'Iveco',
'model': 'Daily',
'odometer': 96238,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_46bf3bfc0cf6178e3c909a854c8fec90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d6f950213857dfb5de98352542fc33d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8de8986d186d8efaff70e3f6046899bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_5e578d2562a2c5b3de5526532c87c0ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_07d2f2a817838e059b0e8d800eaf8686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_baa19ff50ebb68ce2d64f452db34f3a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_480b2490b0afd92fd52bb0e78ed550e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_acf8171ed69e2caf216363e01d0eb8c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_93438d37bf367e84f42fb0dfc0474e91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_350fd6d2e8c4791948fe887190db8e00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_c54f25d6dbedd05780053cc24454f4cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_8d638007e9941a05f7fd1cad934af685.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_3379c84bd688718fa63e78d4d20dd657.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_207dbf8c5ddf399bcb8fa5ed81d88c96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_aff4cad4f144303a699da65f96618956.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_e8b3a81d253e4778e8f01ae13418fbec.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_d3ba7eac12dfee72ddcf313ba8e90b91.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_2fe5366979fa8b19686a79e2bbc5b052.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0c4a37-a6ae-50dd-bc9f-7727565ebb10/db0c4a37-a6ae-50dd-bc9f-7727565ebb10_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/77/1a771f56d9d2d9cfbad72ffaf7c6dd34/pa/CF79780_57d3a385d40dd57a51c077dc19355902.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-05',
'seats_number': 3,
'seller_name': None,
'title': 'Iveco Daily 3.0 Diesel Einzelkabine 35 C Radstand 4100',
'transmission': 'manual',
'trim': 'Einzelkabine 35 C Radstand 4100',
'year': 2021}
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF79780%27 HTTP/1.1" 200 None
2025-12-05 17:02:53 [auto1.fr] INFO: Saving data for CF79780: {'created_time': 1764954173.515382, 'last_price_update_time': 1764954173.515391, 'auction_closing_time': 1765038985.0}
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CF79780') HTTP/1.1" 204 0
2025-12-05 17:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 45df3874-d681-5c6b-a6cf-c7e354da01d5 with identifier: XX15760
2025-12-05 17:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 45df3874-d681-5c6b-a6cf-c7e354da01d5 with identifier: XX15760
2025-12-05 17:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 45df3874-d681-5c6b-a6cf-c7e354da01d5 with identifier: XX15760 to the API
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XX15760>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 204,
'expiration_date': '2025-12-06T16:48:45Z',
'fuel_type': 'electro',
'id': '45df3874-d681-5c6b-a6cf-c7e354da01d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX15760',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Kia',
'model': 'Niro',
'odometer': 70987,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Niro electric drive 150 kW Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2019}
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX15760%27 HTTP/1.1" 200 None
2025-12-05 17:02:53 [auto1.fr] INFO: Saving data for XX15760: {'auction_closing_time': 1765039725.0, 'created_time': 1764842493.534628, 'last_price_update_time': 1764954173.950903}
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XX15760') HTTP/1.1" 204 0
2025-12-05 17:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 812d5fc4-2088-53ce-a117-7f75739dbf9c with identifier: RD60293
2025-12-05 17:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 812d5fc4-2088-53ce-a117-7f75739dbf9c with identifier: RD60293
2025-12-05 17:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 31270, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rd60293', 'expiration_date': '2025-12-06t16:43:52z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '812d5fc4-2088-53ce-a117-7f75739dbf9c', 'current_year_diff': 5, 'age_in_months': 63, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 31270}
Failed validating None in schema:
False
On instance:
{'age_in_months': 63,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 75,
'expiration_date': '2025-12-06t16:43:52z',
'fuel_type': 'petrol',
'id': '812d5fc4-2088-53ce-a117-7f75739dbf9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rd60293',
'listing': 'auction',
'location': 'fr, chartres de bretagne',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 31270,
'odometer_in_km': 31270,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-11',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 edition',
'transmission': 'manual',
'trim': 'edition',
'year': 2020}
2025-12-05 17:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 812d5fc4-2088-53ce-a117-7f75739dbf9c spider: auto1.fr
2025-12-05 17:02:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 812d5fc4-2088-53ce-a117-7f75739dbf9c due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 31270, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rd60293', 'expiration_date': '2025-12-06t16:43:52z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '812d5fc4-2088-53ce-a117-7f75739dbf9c', 'current_year_diff': 5, 'age_in_months': 63, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 31270}
Failed validating None in schema:
False
On instance:
{'age_in_months': 63,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 75,
'expiration_date': '2025-12-06t16:43:52z',
'fuel_type': 'petrol',
'id': '812d5fc4-2088-53ce-a117-7f75739dbf9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rd60293',
'listing': 'auction',
'location': 'fr, chartres de bretagne',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 31270,
'odometer_in_km': 31270,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-11',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 edition',
'transmission': 'manual',
'trim': 'edition',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:43:52Z',
'fuel_type': 'petrol',
'id': '812d5fc4-2088-53ce-a117-7f75739dbf9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD60293',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Opel',
'model': 'Corsa',
'odometer': 31270,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2020}
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD60293%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [auto1.fr] INFO: Saving data for RD60293: {'auction_closing_time': 1765039432.0, 'created_time': 1764151613.292022, 'last_price_update_time': 1764954174.167263}
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD60293') HTTP/1.1" 204 0
2025-12-05 17:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26f44a46-6ea4-5889-81b5-2dcd920950c9 with identifier: PH21838
2025-12-05 17:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26f44a46-6ea4-5889-81b5-2dcd920950c9 with identifier: PH21838
2025-12-05 17:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26f44a46-6ea4-5889-81b5-2dcd920950c9 with identifier: PH21838 to the API
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PH21838>
{'auction_title': '',
'c_o_2_emission_value': 35,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:58:32Z',
'fuel_type': 'hybrid',
'id': '26f44a46-6ea4-5889-81b5-2dcd920950c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH21838',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 26579,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 C-Series',
'transmission': 'automatic',
'trim': 'C-Series',
'year': 2023}
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH21838%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [auto1.fr] INFO: Saving data for PH21838: {'auction_closing_time': 1765040312.0, 'created_time': 1764177283.650008, 'last_price_update_time': 1764954174.535358}
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH21838') HTTP/1.1" 204 0
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS91085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:54 [auto1.fr] INFO: Found listing with ID: RS65907
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS65907%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [auto1.fr] INFO: Scrape type for RS65907: 0
2025-12-05 17:02:54 [auto1.fr] INFO: Found listing with ID: EZ44068
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ44068%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [auto1.fr] INFO: Scrape type for EZ44068: 0
2025-12-05 17:02:54 [auto1.fr] INFO: Found listing with ID: CA56179
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA56179%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [auto1.fr] INFO: Scrape type for CA56179: 2
2025-12-05 17:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS51600> (referer: https://www.auto1.com/v1/car-details-view/VS51600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_489e97a5bd564271fbbf5a11eefed7df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:54 [auto1.fr] INFO: Found listing with ID: RV93754
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV93754%27 HTTP/1.1" 200 None
2025-12-05 17:02:54 [auto1.fr] INFO: Scrape type for RV93754: 2
2025-12-05 17:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 with identifier: JW96531
2025-12-05 17:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 with scrape type 2
2025-12-05 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 with scrape type 2
2025-12-05 17:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60, identifier: JW96531
2025-12-05 17:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c589a6d0>
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F92%252Fab92ef2f8f71b3354fe18cbc6f35e333%252Fpa%252FAU18271_4340b56ad92e32e979efc32eeee362b2.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4340b56ad92e32e979efc32eeee362b2.jpg saved to cache
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde
2025-12-05 17:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b9f9958-291d-50fe-9e8b-5c5381eefbde, skipping ID generation
2025-12-05 17:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde with scrape type 1
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3b9f9958-291d-50fe-9e8b-5c5381eefbde from tracking dictionaries
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b9f9958-291d-50fe-9e8b-5c5381eefbde sending to next pipeline
2025-12-05 17:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3b9f9958-291d-50fe-9e8b-5c5381eefbde, identifier: AU18271
2025-12-05 17:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 with identifier: JW96531
2025-12-05 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 with identifier: JW96531
2025-12-05 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 e-vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 120266, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jw96531', 'expiration_date': '2025-12-06t16:23:16z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '2b8b9179-faf4-5de2-b3fb-2cafc1fecd60', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 120266}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:23:16z',
'fuel_type': 'petrol',
'id': '2b8b9179-faf4-5de2-b3fb-2cafc1fecd60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jw96531',
'listing': 'auction',
'location': 'fr, beaucaire',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 120266,
'odometer_in_km': 120266,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-23',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 e-vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2017}
2025-12-05 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 spider: auto1.fr
2025-12-05 17:02:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2b8b9179-faf4-5de2-b3fb-2cafc1fecd60 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 e-vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 120266, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jw96531', 'expiration_date': '2025-12-06t16:23:16z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '2b8b9179-faf4-5de2-b3fb-2cafc1fecd60', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 120266}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:23:16z',
'fuel_type': 'petrol',
'id': '2b8b9179-faf4-5de2-b3fb-2cafc1fecd60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jw96531',
'listing': 'auction',
'location': 'fr, beaucaire',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 120266,
'odometer_in_km': 120266,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-23',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 e-vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:23:16Z',
'fuel_type': 'petrol',
'id': '2b8b9179-faf4-5de2-b3fb-2cafc1fecd60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW96531',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '208',
'odometer': 120266,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 e-VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW96531%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Saving data for JW96531: {'auction_closing_time': 1765038196.0, 'created_time': 1764756467.558038, 'last_price_update_time': 1764954175.411901}
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JW96531') HTTP/1.1" 204 0
2025-12-05 17:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3b9f9958-291d-50fe-9e8b-5c5381eefbde with identifier: AU18271
2025-12-05 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3b9f9958-291d-50fe-9e8b-5c5381eefbde with identifier: AU18271
2025-12-05 17:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3b9f9958-291d-50fe-9e8b-5c5381eefbde with identifier: AU18271 to the API
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4340b56ad92e32e979efc32eeee362b2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2025-12-06T16:00:33Z',
'fuel_type': 'petrol',
'id': '3b9f9958-291d-50fe-9e8b-5c5381eefbde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU18271',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 90324,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_c08f22e98003ff313b5951e4d07fc980.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_02c367dfe19c43d27a3a1ff3004c1d19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2360509,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4340b56ad92e32e979efc32eeee362b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_2f316d3926da618cb5d8938856d206d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b04c03261a2247ff3b4a33c024c8dba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ef6f40d44339e278b154fcb226f55fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_54af58a69f8d7a063c5625704f87ae4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2279834,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_8ace67e5be0704e19e27d76bc7fc3f13.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2179442,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_4ec88f3c3ba1b10a4d60c5e0d7cff3cb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2237491,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_29f0f46d25c20d97eff3f23b0a83c2bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_7c0167771ce089d6938c770d41475d24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1d649f80f4c31f5d0bd8ad047eebb982.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_eda6d3cb996e565e1b2a5c91f23c946f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2320545,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_1fbed5568e8fe187382f272f2bf4fe78.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_b831399e58ebeeed25c7c37ac27ad6de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b9f9958-291d-50fe-9e8b-5c5381eefbde/3b9f9958-291d-50fe-9e8b-5c5381eefbde_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71704,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgab/92/ab92ef2f8f71b3354fe18cbc6f35e333/pa/AU18271_213d27419084364bc56e395132775bde.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 40 TFSI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU18271%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Saving data for AU18271: {'created_time': 1764954175.786366, 'last_price_update_time': 1764954175.786378, 'auction_closing_time': 1765036833.0}
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU18271') HTTP/1.1" 204 0
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: VR90520
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR90520%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for VR90520: 0
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: LP45751
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP45751%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for LP45751: 0
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: GN84504
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN84504%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for GN84504: 0
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: MJ41716
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ41716%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for MJ41716: 0
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: MV78340
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV78340%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for MV78340: 1
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: TT18365
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT18365%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for TT18365: 0
2025-12-05 17:02:55 [auto1.fr] INFO: Found listing with ID: UL22558
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL22558%27 HTTP/1.1" 200 None
2025-12-05 17:02:55 [auto1.fr] INFO: Scrape type for UL22558: 2
2025-12-05 17:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be029f0a-f12e-550f-a02a-afc4f4689d2c with identifier: VS51600
2025-12-05 17:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be029f0a-f12e-550f-a02a-afc4f4689d2c with scrape type 2
2025-12-05 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be029f0a-f12e-550f-a02a-afc4f4689d2c with scrape type 2
2025-12-05 17:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be029f0a-f12e-550f-a02a-afc4f4689d2c, identifier: VS51600
2025-12-05 17:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5775010>
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F2f%252Fed2f897a538faaca150e5516d969f115%252Fpa%252FYF11400_489e97a5bd564271fbbf5a11eefed7df.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_489e97a5bd564271fbbf5a11eefed7df.jpg saved to cache
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f55a4b08-5ea2-59c9-8935-984e5cb30a84
2025-12-05 17:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f55a4b08-5ea2-59c9-8935-984e5cb30a84, skipping ID generation
2025-12-05 17:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55a4b08-5ea2-59c9-8935-984e5cb30a84 with scrape type 1
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f55a4b08-5ea2-59c9-8935-984e5cb30a84 from tracking dictionaries
2025-12-05 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f55a4b08-5ea2-59c9-8935-984e5cb30a84 sending to next pipeline
2025-12-05 17:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f55a4b08-5ea2-59c9-8935-984e5cb30a84, identifier: YF11400
2025-12-05 17:02:56 [auto1.fr] INFO: Found listing with ID: TH84704
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH84704%27 HTTP/1.1" 200 None
2025-12-05 17:02:56 [auto1.fr] INFO: Scrape type for TH84704: 2
2025-12-05 17:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be029f0a-f12e-550f-a02a-afc4f4689d2c with identifier: VS51600
2025-12-05 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be029f0a-f12e-550f-a02a-afc4f4689d2c with identifier: VS51600
2025-12-05 17:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be029f0a-f12e-550f-a02a-afc4f4689d2c with identifier: VS51600 to the API
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VS51600>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:59:24Z',
'fuel_type': 'diesel',
'id': 'be029f0a-f12e-550f-a02a-afc4f4689d2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS51600',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '3008',
'odometer': 91906,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS51600%27 HTTP/1.1" 200 None
2025-12-05 17:02:56 [auto1.fr] INFO: Saving data for VS51600: {'auction_closing_time': 1765040364.0, 'created_time': 1764842768.599226, 'last_price_update_time': 1764954176.889318}
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS51600') HTTP/1.1" 204 0
2025-12-05 17:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f55a4b08-5ea2-59c9-8935-984e5cb30a84 with identifier: YF11400
2025-12-05 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f55a4b08-5ea2-59c9-8935-984e5cb30a84 with identifier: YF11400
2025-12-05 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f55a4b08-5ea2-59c9-8935-984e5cb30a84 spider: auto1.fr
2025-12-05 17:02:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f55a4b08-5ea2-59c9-8935-984e5cb30a84 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:42:09Z',
'fuel_type': 'diesel',
'id': 'f55a4b08-5ea2-59c9-8935-984e5cb30a84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF11400',
'listing': 'auction',
'location': 'FR, Marsannay-la-Côte',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 68449,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_2ef28caa5e2c7878359f0ed8a8fc45b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2518324,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_489e97a5bd564271fbbf5a11eefed7df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fbc00be8ae5ef80cb6b2a0c2bb7aee11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2610657,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c5fed4c70115362b25ce5926ca63b240.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2803107,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_f5ef4fe8a6309410a8af2fd0169f0efc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2800149,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ecf7f8e25d6040aaf7b34d004b7318b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_ef6741b1220762fec61d6952935c67a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_74ddea0e8b538778a347675b589bbab2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2919950,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_0a65d38a9e6d5319c813316a6d0beeea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2786564,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_a17475942019e39502152aeb72eb2e1f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_37820a07d76f07ea8d060439b8c7b78b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2799862,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_fa8fa532773ec8dcc5ceb38196ba3bc4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_bdc93b4273061c29dad81fba0abdd98d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_30f1de6e85839592f1ddad394f9e4f02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_c50755185c10e059a2704b52d8674a07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55a4b08-5ea2-59c9-8935-984e5cb30a84/f55a4b08-5ea2-59c9-8935-984e5cb30a84_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82395,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imged/2f/ed2f897a538faaca150e5516d969f115/pa/YF11400_757d0cd74115d01157fd5eafa5f4aeeb.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-11',
'seats_number': 6,
'seller_name': None,
'title': 'Peugeot Expert 1.6 Blue-HDi Premium L2',
'transmission': 'manual',
'trim': 'Premium L2',
'year': 2018}
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF11400%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Saving data for YF11400: {'created_time': 1764954177.188515, 'last_price_update_time': 1764954177.188526, 'auction_closing_time': 1765039329.0}
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YF11400') HTTP/1.1" 204 0
2025-12-05 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: VS80365
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS80365%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for VS80365: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: EB22358
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB22358%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for EB22358: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: WV79747
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV79747%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for WV79747: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: VS81505
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS81505%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for VS81505: 2
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: AC35213
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35213%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for AC35213: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: EZ57061
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ57061%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for EZ57061: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: LG70550
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG70550%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for LG70550: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: JL02911
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL02911%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for JL02911: 2
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: XE12078
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE12078%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for XE12078: 1
2025-12-05 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: UJ33328
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ33328%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for UJ33328: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: EU94509
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU94509%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for EU94509: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: VV03298
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV03298%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for VV03298: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: UG17095
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG17095%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for UG17095: 2
2025-12-05 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: WC17201
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC17201%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for WC17201: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: KS21323
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS21323%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for KS21323: 0
2025-12-05 17:02:57 [auto1.fr] INFO: Found listing with ID: YT07922
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT07922%27 HTTP/1.1" 200 None
2025-12-05 17:02:57 [auto1.fr] INFO: Scrape type for YT07922: 2
2025-12-05 17:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5849d90>
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_a47757b42829590d18c7b498ec8a3bc8.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg saved to cache
2025-12-05 17:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ91809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c92d50>
2025-12-05 17:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F78%252Fda78a242593cda0ad3e232570c01282d%252Fpa%252FAY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg') HTTP/1.1" 204 0
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg saved to cache
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d16719b-7728-5160-9ec4-52e66e7dfe65
2025-12-05 17:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d16719b-7728-5160-9ec4-52e66e7dfe65, skipping ID generation
2025-12-05 17:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d16719b-7728-5160-9ec4-52e66e7dfe65 with scrape type 1
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1d16719b-7728-5160-9ec4-52e66e7dfe65 from tracking dictionaries
2025-12-05 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d16719b-7728-5160-9ec4-52e66e7dfe65 sending to next pipeline
2025-12-05 17:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d16719b-7728-5160-9ec4-52e66e7dfe65, identifier: AY54511
2025-12-05 17:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d16719b-7728-5160-9ec4-52e66e7dfe65 with identifier: AY54511
2025-12-05 17:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d16719b-7728-5160-9ec4-52e66e7dfe65 with identifier: AY54511
2025-12-05 17:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 80033, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay54511', 'expiration_date': '2025-12-06t16:47:53z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 5', 'c_o_2_emission_value': 112, 'id': '1d16719b-7728-5160-9ec4-52e66e7dfe65', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2873459}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2826569}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59280}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2626416}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2664038}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2492745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62313}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62616}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2730485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53058}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69073}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 33638}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78296}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91426}], 'current_year_diff': 7, 'age_in_months': 85, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 80033}
Failed validating None in schema:
False
On instance:
{'age_in_months': 85,
'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 5',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:47:53z',
'fuel_type': 'petrol',
'id': '1d16719b-7728-5160-9ec4-52e66e7dfe65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay54511',
'listing': 'auction',
'location': 'fr, metz',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 80033,
'odometer_in_km': 80033,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2873459,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2826569,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626416,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664038,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2492745,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730485,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-14',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 e-vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2018}
2025-12-05 17:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 1d16719b-7728-5160-9ec4-52e66e7dfe65 spider: auto1.fr
2025-12-05 17:02:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1d16719b-7728-5160-9ec4-52e66e7dfe65 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 80033, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay54511', 'expiration_date': '2025-12-06t16:47:53z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 5', 'c_o_2_emission_value': 112, 'id': '1d16719b-7728-5160-9ec4-52e66e7dfe65', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2873459}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2826569}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59280}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2626416}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2664038}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2492745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62313}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62616}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2730485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53058}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69073}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 33638}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78296}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91426}], 'current_year_diff': 7, 'age_in_months': 85, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 80033}
Failed validating None in schema:
False
On instance:
{'age_in_months': 85,
'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 5',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:47:53z',
'fuel_type': 'petrol',
'id': '1d16719b-7728-5160-9ec4-52e66e7dfe65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay54511',
'listing': 'auction',
'location': 'fr, metz',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 80033,
'odometer_in_km': 80033,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2873459,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2826569,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626416,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664038,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2492745,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730485,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-14',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 e-vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:47:53Z',
'fuel_type': 'petrol',
'id': '1d16719b-7728-5160-9ec4-52e66e7dfe65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY54511',
'listing': 'auction',
'location': 'FR, Metz',
'make': 'Peugeot',
'model': '2008',
'odometer': 80033,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2873459,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_38d06bee002dbdeda16c159706adf9ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_618f596948b62481a89d8011af4d3052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2826569,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d1a61065626602847fb203c5788802b1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_584276307a0fd8d9f6186660938e28aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626416,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ca96992bd45cd71761ec266de0623732.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664038,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_fc2854e14031dc877630db8843e8aa14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2492745,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a47757b42829590d18c7b498ec8a3bc8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_a4e4625db958f84873314b5848b4b055.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_ddd653bd9a13d0e8b18dd79f187bb1ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730485,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_593e9ce9723d4c4a85a635f6a8168cd2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c20a270e13d21ac85e8cc4dc8555f5dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_c91d30bb59e0ecd6b8def261c02742b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_dd41178e4d31d92ee7f98e5002b6626a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_d64bbb02c5cbd2a392bca2ed1d19bacb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_aa36466318fa32b016f9d3d0ffcca9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d16719b-7728-5160-9ec4-52e66e7dfe65/1d16719b-7728-5160-9ec4-52e66e7dfe65_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/78/da78a242593cda0ad3e232570c01282d/pa/AY54511_0309d895ab0d1292cfe2214e9f7b382c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY54511%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Saving data for AY54511: {'created_time': 1764954178.533454, 'last_price_update_time': 1764954178.533465, 'auction_closing_time': 1765039673.0}
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY54511') HTTP/1.1" 204 0
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB61551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY67356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL22558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV78340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV93754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:58 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: FX25877
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX25877%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for FX25877: 2
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: SR81318
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR81318%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for SR81318: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: ZE67504
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE67504%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for ZE67504: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: LX89849
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX89849%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for LX89849: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: JG36743
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG36743%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for JG36743: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: MU16943
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU16943%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for MU16943: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: BN40818
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN40818%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for BN40818: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: UR41069
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR41069%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for UR41069: 2
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: RW47310
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW47310%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for RW47310: 2
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: AE28497
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE28497%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for AE28497: 2
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: KM82202
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM82202%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for KM82202: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: NT74961
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT74961%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for NT74961: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: MK72623
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK72623%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for MK72623: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: XB82881
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB82881%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for XB82881: 0
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: WD20324
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD20324%27 HTTP/1.1" 200 None
2025-12-05 17:02:58 [auto1.fr] INFO: Scrape type for WD20324: 2
2025-12-05 17:02:58 [auto1.fr] INFO: Found listing with ID: RR36319
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR36319%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for RR36319: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: RB92334
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB92334%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for RB92334: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: YV72090
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV72090%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for YV72090: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: DS87228
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS87228%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for DS87228: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: AY46442
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY46442%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for AY46442: 2
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: EG57003
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG57003%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for EG57003: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: FH25622
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH25622%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for FH25622: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: FD69893
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD69893%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for FD69893: 2
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: NB05598
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB05598%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for NB05598: 2
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: WE02263
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE02263%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for WE02263: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: BJ56682
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ56682%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for BJ56682: 2
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: VC32845
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC32845%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for VC32845: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: JB34017
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB34017%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for JB34017: 1
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: EZ24789
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ24789%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for EZ24789: 2
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: JE77720
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE77720%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for JE77720: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: KV40732
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV40732%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for KV40732: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: UT59463
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT59463%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for UT59463: 2
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: UE27789
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE27789%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for UE27789: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: CD81003
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD81003%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for CD81003: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: ET50296
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET50296%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for ET50296: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: ZU28125
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU28125%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for ZU28125: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: XL04405
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL04405%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for XL04405: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: LP51275
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP51275%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for LP51275: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: DL92196
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL92196%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for DL92196: 0
2025-12-05 17:02:59 [auto1.fr] INFO: Found listing with ID: JF49418
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF49418%27 HTTP/1.1" 200 None
2025-12-05 17:02:59 [auto1.fr] INFO: Scrape type for JF49418: 2
2025-12-05 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA56179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE12078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT07922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS91085> (referer: https://www.auto1.com/v1/car-details-view/XS91085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS81505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL02911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d0b199-2218-5d9e-a26c-d86b419dcb4e with identifier: XS91085
2025-12-05 17:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d0b199-2218-5d9e-a26c-d86b419dcb4e with scrape type 2
2025-12-05 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8d0b199-2218-5d9e-a26c-d86b419dcb4e with scrape type 2
2025-12-05 17:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8d0b199-2218-5d9e-a26c-d86b419dcb4e, identifier: XS91085
2025-12-05 17:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8d0b199-2218-5d9e-a26c-d86b419dcb4e with identifier: XS91085
2025-12-05 17:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8d0b199-2218-5d9e-a26c-d86b419dcb4e with identifier: XS91085
2025-12-05 17:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 37448, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xs91085', 'expiration_date': '2025-12-06t16:16:50z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, le havre', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 135, 'id': 'e8d0b199-2218-5d9e-a26c-d86b419dcb4e', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 37448}
Failed validating None in schema:
False
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': 135,
'category': 'rental',
'color': 'orange',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:16:50z',
'fuel_type': 'petrol',
'id': 'e8d0b199-2218-5d9e-a26c-d86b419dcb4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xs91085',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 37448,
'odometer_in_km': 37448,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-16',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2022}
2025-12-05 17:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e8d0b199-2218-5d9e-a26c-d86b419dcb4e spider: auto1.fr
2025-12-05 17:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e8d0b199-2218-5d9e-a26c-d86b419dcb4e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 37448, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xs91085', 'expiration_date': '2025-12-06t16:16:50z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, le havre', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 135, 'id': 'e8d0b199-2218-5d9e-a26c-d86b419dcb4e', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 37448}
Failed validating None in schema:
False
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': 135,
'category': 'rental',
'color': 'orange',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:16:50z',
'fuel_type': 'petrol',
'id': 'e8d0b199-2218-5d9e-a26c-d86b419dcb4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xs91085',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 37448,
'odometer_in_km': 37448,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-16',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': 'Rental',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:16:50Z',
'fuel_type': 'petrol',
'id': 'e8d0b199-2218-5d9e-a26c-d86b419dcb4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS91085',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Peugeot',
'model': '2008',
'odometer': 37448,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS91085%27 HTTP/1.1" 200 None
2025-12-05 17:03:00 [auto1.fr] INFO: Saving data for XS91085: {'auction_closing_time': 1765037810.0, 'created_time': 1764842664.040385, 'last_price_update_time': 1764954180.241025}
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XS91085') HTTP/1.1" 204 0
2025-12-05 17:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH84704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG17095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ91809> (referer: https://www.auto1.com/v1/car-details-view/UZ91809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d39708d-e341-597b-91d0-c546017ac2a4 with identifier: UZ91809
2025-12-05 17:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d39708d-e341-597b-91d0-c546017ac2a4 with scrape type 2
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d39708d-e341-597b-91d0-c546017ac2a4 with scrape type 2
2025-12-05 17:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d39708d-e341-597b-91d0-c546017ac2a4, identifier: UZ91809
2025-12-05 17:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d39708d-e341-597b-91d0-c546017ac2a4 with identifier: UZ91809
2025-12-05 17:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d39708d-e341-597b-91d0-c546017ac2a4 with identifier: UZ91809
2025-12-05 17:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d39708d-e341-597b-91d0-c546017ac2a4 with identifier: UZ91809 to the API
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ91809>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 455,
'expiration_date': '2025-12-06T16:58:27Z',
'fuel_type': 'hybrid',
'id': '1d39708d-e341-597b-91d0-c546017ac2a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ91809',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'Volvo',
'model': 'XC90',
'odometer': 45160,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC90 2.0 T8 Recharge Plug-in Hybrid Ultimate Bright AWD',
'transmission': 'automatic',
'trim': 'Ultimate Bright AWD',
'year': 2023}
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ91809%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Saving data for UZ91809: {'auction_closing_time': 1765040307.0, 'created_time': 1764867756.410453, 'last_price_update_time': 1764954181.505666}
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ91809') HTTP/1.1" 204 0
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX25877/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN69075> (referer: https://www.auto1.com/v1/car-details-view/MN69075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW47310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV93754> (referer: https://www.auto1.com/v1/car-details-view/RV93754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: GU49466
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU49466%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for GU49466: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: CJ91961
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ91961%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for CJ91961: 2
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: AC02767
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC02767%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for AC02767: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: BP09504
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP09504%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for BP09504: 2
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: BC27848
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC27848%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for BC27848: 2
2025-12-05 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV78340> (referer: https://www.auto1.com/v1/car-details-view/MV78340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: UK05835
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK05835%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for UK05835: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: CG83209
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG83209%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for CG83209: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: RJ16333
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ16333%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for RJ16333: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: LB67796
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB67796%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for LB67796: 2
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: MH48089
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH48089%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for MH48089: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: LW66847
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW66847%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for LW66847: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: AS67204
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS67204%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for AS67204: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: SY87891
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY87891%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for SY87891: 0
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: GW95758
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW95758%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for GW95758: 2
2025-12-05 17:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 with identifier: MN69075
2025-12-05 17:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 with scrape type 1
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_a9cd25e1a657c0a4df4e12bbc4fc25fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_a9cd25e1a657c0a4df4e12bbc4fc25fe.jpg not downloaded yet
2025-12-05 17:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 with identifier: RV93754
2025-12-05 17:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 with scrape type 2
2025-12-05 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 with scrape type 2
2025-12-05 17:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a2600ce-dad6-5a1c-b6fa-90064e10eec1, identifier: RV93754
2025-12-05 17:03:01 [auto1.fr] INFO: Found listing with ID: CY80790
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY80790%27 HTTP/1.1" 200 None
2025-12-05 17:03:01 [auto1.fr] INFO: Scrape type for CY80790: 2
2025-12-05 17:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 with identifier: RV93754
2025-12-05 17:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 with identifier: RV93754
2025-12-05 17:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144684 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
144684
2025-12-05 17:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 spider: auto1.fr
2025-12-05 17:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a2600ce-dad6-5a1c-b6fa-90064e10eec1 due to rule: high_mileage_for_make.json, error: 144684 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
144684
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2025-12-06T16:31:54Z',
'fuel_type': 'petrol',
'id': '4a2600ce-dad6-5a1c-b6fa-90064e10eec1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV93754',
'listing': 'auction',
'location': 'FR, Reims',
'make': 'Renault',
'model': 'Clio',
'odometer': 144684,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV93754%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Saving data for RV93754: {'auction_closing_time': 1765038714.0, 'created_time': 1764867632.841342, 'last_price_update_time': 1764954182.161779}
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV93754') HTTP/1.1" 204 0
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg not downloaded yet
2025-12-05 17:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a01bbe88-640d-5aff-ac30-821a7165c16d with identifier: MV78340
2025-12-05 17:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a01bbe88-640d-5aff-ac30-821a7165c16d with scrape type 1
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_55f426219ff76010095f0fb847927b44.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_55f426219ff76010095f0fb847927b44.jpg not downloaded yet
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: ZD99974
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD99974%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for ZD99974: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: SN56812
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN56812%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for SN56812: 2
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_36fd5607bdaff39b5c45c8e3a3ad1a48.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_36fd5607bdaff39b5c45c8e3a3ad1a48.jpg not downloaded yet
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_46cf5868d0d6712a61f854c7a085e1d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_46cf5868d0d6712a61f854c7a085e1d6.jpg not downloaded yet
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: ZA00385
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA00385%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for ZA00385: 2
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_f00bd4b23cc6c1f11dca76ff3af9fce0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f00bd4b23cc6c1f11dca76ff3af9fce0.jpg not downloaded yet
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_e12692da1799384bf54c2483acf37083.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e12692da1799384bf54c2483acf37083.jpg not downloaded yet
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: UZ57263
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ57263%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for UZ57263: 2
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_f0845d5831c6010a7ca201568bf3928b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f0845d5831c6010a7ca201568bf3928b.jpg not downloaded yet
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_53cac0ceafd9be25c05283b86ad32098.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_53cac0ceafd9be25c05283b86ad32098.jpg not downloaded yet
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: XL41692
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL41692%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for XL41692: 1
2025-12-05 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA56179> (referer: https://www.auto1.com/v1/car-details-view/CA56179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF49418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_bbd11c80e76b0545499717f940ef769d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_bbd11c80e76b0545499717f940ef769d.jpg not downloaded yet
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_86f073539b44b6cee2914de40fdc2699.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_86f073539b44b6cee2914de40fdc2699.jpg not downloaded yet
2025-12-05 17:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: SD43966
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD43966%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for SD43966: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: RR56458
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR56458%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for RR56458: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: HY39705
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY39705%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for HY39705: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: XP65277
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP65277%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for XP65277: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: MV70979
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV70979%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for MV70979: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: HC03144
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC03144%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for HC03144: 2
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_dcb65ffcab95d86fece6d4636b9e783b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_dcb65ffcab95d86fece6d4636b9e783b.jpg not downloaded yet
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_0c88bbfd5de352c68c3efde4fba77612.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_0c88bbfd5de352c68c3efde4fba77612.jpg not downloaded yet
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: LB30368
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB30368%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for LB30368: 2
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_718a24e2789d75184d1fcf6659a3adb5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_718a24e2789d75184d1fcf6659a3adb5.jpg not downloaded yet
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_7d0e3e4ca3c3e710fa1b891c1898247c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_7d0e3e4ca3c3e710fa1b891c1898247c.jpg not downloaded yet
2025-12-05 17:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf with identifier: CA56179
2025-12-05 17:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf with scrape type 2
2025-12-05 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf with scrape type 2
2025-12-05 17:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf, identifier: CA56179
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: DB83269
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB83269%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for DB83269: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: PW91709
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW91709%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for PW91709: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: YW79222
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW79222%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for YW79222: 0
2025-12-05 17:03:02 [auto1.fr] INFO: Found listing with ID: LL50485
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL50485%27 HTTP/1.1" 200 None
2025-12-05 17:03:02 [auto1.fr] INFO: Scrape type for LL50485: 2
2025-12-05 17:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf with identifier: CA56179
2025-12-05 17:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf with identifier: CA56179
2025-12-05 17:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 957f98e2-14ae-5ea7-91d1-627bfc2cd2bf with identifier: CA56179 to the API
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA56179>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:15:45Z',
'fuel_type': 'diesel',
'id': '957f98e2-14ae-5ea7-91d1-627bfc2cd2bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA56179',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 69759,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2022}
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA56179%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [auto1.fr] INFO: Saving data for CA56179: {'auction_closing_time': 1765037745.0, 'created_time': 1764842571.608083, 'last_price_update_time': 1764954183.67332}
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA56179') HTTP/1.1" 204 0
2025-12-05 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_53cac0ceafd9be25c05283b86ad32098.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_f1a2e9c4e0040c99ac8e98383f62f2f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f1a2e9c4e0040c99ac8e98383f62f2f3.jpg not downloaded yet
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_e694b156224abf6e2fc5448287403f24.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e694b156224abf6e2fc5448287403f24.jpg not downloaded yet
2025-12-05 17:03:03 [auto1.fr] INFO: Found listing with ID: PF80977
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF80977%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [auto1.fr] INFO: Scrape type for PF80977: 0
2025-12-05 17:03:03 [auto1.fr] INFO: Found listing with ID: AT54275
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT54275%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [auto1.fr] INFO: Scrape type for AT54275: 0
2025-12-05 17:03:03 [auto1.fr] INFO: Found listing with ID: BY85215
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY85215%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [auto1.fr] INFO: Scrape type for BY85215: 0
2025-12-05 17:03:03 [auto1.fr] INFO: Found listing with ID: ZK67135
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK67135%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [auto1.fr] INFO: Scrape type for ZK67135: 2
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_eb02196182de6d7fb9f2883a23893153.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_eb02196182de6d7fb9f2883a23893153.jpg not downloaded yet
2025-12-05 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_9968920655eeee59192a00c66f602bab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_9968920655eeee59192a00c66f602bab.jpg not downloaded yet
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE12078> (referer: https://www.auto1.com/v1/car-details-view/XE12078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT59463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT07922> (referer: https://www.auto1.com/v1/car-details-view/YT07922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB34017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:04 [auto1.fr] INFO: Found listing with ID: EV32720
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV32720%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.fr] INFO: Scrape type for EV32720: 0
2025-12-05 17:03:04 [auto1.fr] INFO: Found listing with ID: TT75877
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT75877%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.fr] INFO: Scrape type for TT75877: 0
2025-12-05 17:03:04 [auto1.fr] INFO: Found listing with ID: CV35346
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV35346%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.fr] INFO: Scrape type for CV35346: 0
2025-12-05 17:03:04 [auto1.fr] INFO: Found listing with ID: UK51422
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK51422%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.fr] INFO: Scrape type for UK51422: 0
2025-12-05 17:03:04 [auto1.fr] INFO: Found listing with ID: AS82755
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS82755%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.fr] INFO: Scrape type for AS82755: 0
2025-12-05 17:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_4b6465312ba104612974b11cc1d09c15.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_4b6465312ba104612974b11cc1d09c15.jpg not downloaded yet
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_acb96ffb07c59bb7e8b69e1f181597e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_acb96ffb07c59bb7e8b69e1f181597e9.jpg not downloaded yet
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_292eb9acb1af6d3d682dcc4cff85fbff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_292eb9acb1af6d3d682dcc4cff85fbff.jpg not downloaded yet
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_15e9e84eb9299583eed685921d17a271.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_15e9e84eb9299583eed685921d17a271.jpg not downloaded yet
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d7e310>
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_53cac0ceafd9be25c05283b86ad32098.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_53cac0ceafd9be25c05283b86ad32098.jpg saved to cache
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_30eca362a36a2ebed4af7e9217d60729.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_30eca362a36a2ebed4af7e9217d60729.jpg not downloaded yet
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_11ff0e966ead3495dbad7e87f72216e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_11ff0e966ead3495dbad7e87f72216e4.jpg not downloaded yet
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e694b156224abf6e2fc5448287403f24.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f1a2e9c4e0040c99ac8e98383f62f2f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc with identifier: XE12078
2025-12-05 17:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc with scrape type 1
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_d371fccfe35ff0fe048b0206f2bdfb7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_d371fccfe35ff0fe048b0206f2bdfb7b.jpg not downloaded yet
2025-12-05 17:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8dbcc80-1800-5f5b-bcdc-abe7684359af with identifier: YT07922
2025-12-05 17:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8dbcc80-1800-5f5b-bcdc-abe7684359af with scrape type 2
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8dbcc80-1800-5f5b-bcdc-abe7684359af with scrape type 2
2025-12-05 17:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8dbcc80-1800-5f5b-bcdc-abe7684359af, identifier: YT07922
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_c8e3ed6cafa8f20e62789fb20f5714ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c8e3ed6cafa8f20e62789fb20f5714ba.jpg not downloaded yet
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_01e7518ebedd17e164c1cf2284263a7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_01e7518ebedd17e164c1cf2284263a7e.jpg not downloaded yet
2025-12-05 17:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8dbcc80-1800-5f5b-bcdc-abe7684359af with identifier: YT07922
2025-12-05 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8dbcc80-1800-5f5b-bcdc-abe7684359af with identifier: YT07922
2025-12-05 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo excellence', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 146572, 'odometer_reading_unit': 'km', 'registration_date': '2019-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt07922', 'expiration_date': '2025-12-06t16:17:01z', 'origin_country_code': 'fr', 'trim': 'excellence', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': 'a8dbcc80-1800-5f5b-bcdc-abe7684359af', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 146572}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:17:01z',
'fuel_type': 'petrol',
'id': 'a8dbcc80-1800-5f5b-bcdc-abe7684359af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt07922',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 146572,
'odometer_in_km': 146572,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo excellence',
'transmission': 'manual',
'trim': 'excellence',
'year': 2019}
2025-12-05 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: a8dbcc80-1800-5f5b-bcdc-abe7684359af spider: auto1.fr
2025-12-05 17:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a8dbcc80-1800-5f5b-bcdc-abe7684359af due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo excellence', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 146572, 'odometer_reading_unit': 'km', 'registration_date': '2019-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt07922', 'expiration_date': '2025-12-06t16:17:01z', 'origin_country_code': 'fr', 'trim': 'excellence', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': 'a8dbcc80-1800-5f5b-bcdc-abe7684359af', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 146572}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:17:01z',
'fuel_type': 'petrol',
'id': 'a8dbcc80-1800-5f5b-bcdc-abe7684359af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt07922',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 146572,
'odometer_in_km': 146572,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo excellence',
'transmission': 'manual',
'trim': 'excellence',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:17:01Z',
'fuel_type': 'petrol',
'id': 'a8dbcc80-1800-5f5b-bcdc-abe7684359af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT07922',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 146572,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Excellence',
'transmission': 'manual',
'trim': 'Excellence',
'year': 2019}
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT07922%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [auto1.fr] INFO: Saving data for YT07922: {'auction_closing_time': 1765037821.0, 'created_time': 1763485650.303133, 'last_price_update_time': 1764954184.934588}
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT07922') HTTP/1.1" 204 0
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_88747d4e29da210ecd57a4da458390c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_88747d4e29da210ecd57a4da458390c6.jpg not downloaded yet
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_c08eb78c951ec2609836f9c953962f2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c08eb78c951ec2609836f9c953962f2a.jpg not downloaded yet
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_553d8f896bbad0b5a5c7f616e7b17791.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_553d8f896bbad0b5a5c7f616e7b17791.jpg not downloaded yet
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5937550>
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_e694b156224abf6e2fc5448287403f24.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e694b156224abf6e2fc5448287403f24.jpg saved to cache
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5937ed0>
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_f1a2e9c4e0040c99ac8e98383f62f2f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f1a2e9c4e0040c99ac8e98383f62f2f3.jpg saved to cache
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_1867b78974d87b55c44e089618694ae3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_1867b78974d87b55c44e089618694ae3.jpg not downloaded yet
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG17095> (referer: https://www.auto1.com/v1/car-details-view/UG17095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH84704> (referer: https://www.auto1.com/v1/car-details-view/TH84704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_d057bfd55c65a868a3359cb074fb97df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_d057bfd55c65a868a3359cb074fb97df.jpg not downloaded yet
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_3f5cc94cdec11a6d1fdbaaa7c82b06f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_3f5cc94cdec11a6d1fdbaaa7c82b06f7.jpg not downloaded yet
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_15e9e84eb9299583eed685921d17a271.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_014c719aef3f938f1a97ef7e1eeac7d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_014c719aef3f938f1a97ef7e1eeac7d5.jpg not downloaded yet
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ24789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_84c471438a293483cdcdaaca759ade39.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_84c471438a293483cdcdaaca759ade39.png not downloaded yet
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_9cfe82ae0c751026c04a0714822146b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_9cfe82ae0c751026c04a0714822146b4.jpg not downloaded yet
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_aaa0aa0c6ad1e9736907ae0b1288b61b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_aaa0aa0c6ad1e9736907ae0b1288b61b.jpg not downloaded yet
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB05598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_553d8f896bbad0b5a5c7f616e7b17791.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_ea49ab1889a9f2056f4e923bae718bad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ea49ab1889a9f2056f4e923bae718bad.jpg not downloaded yet
2025-12-05 17:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f1ee97c-327e-5343-ad54-f35cace1b1ba with identifier: UG17095
2025-12-05 17:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1ee97c-327e-5343-ad54-f35cace1b1ba with scrape type 2
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f1ee97c-327e-5343-ad54-f35cace1b1ba with scrape type 2
2025-12-05 17:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f1ee97c-327e-5343-ad54-f35cace1b1ba, identifier: UG17095
2025-12-05 17:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13 with identifier: TH84704
2025-12-05 17:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13 with scrape type 2
2025-12-05 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13 with scrape type 2
2025-12-05 17:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13, identifier: TH84704
2025-12-05 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c08eb78c951ec2609836f9c953962f2a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f1ee97c-327e-5343-ad54-f35cace1b1ba with identifier: UG17095
2025-12-05 17:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f1ee97c-327e-5343-ad54-f35cace1b1ba with identifier: UG17095
2025-12-05 17:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1f1ee97c-327e-5343-ad54-f35cace1b1ba with identifier: UG17095 to the API
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG17095>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 258,
'expiration_date': '2025-12-06T16:45:13Z',
'fuel_type': 'petrol',
'id': '1f1ee97c-327e-5343-ad54-f35cace1b1ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG17095',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': '3er',
'odometer': 46272,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 330i xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2021}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG17095%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [auto1.fr] INFO: Saving data for UG17095: {'auction_closing_time': 1765039513.0, 'created_time': 1764756117.463646, 'last_price_update_time': 1764954186.25407}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG17095') HTTP/1.1" 204 0
2025-12-05 17:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13 with identifier: TH84704
2025-12-05 17:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13 with identifier: TH84704
2025-12-05 17:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13 with identifier: TH84704 to the API
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH84704>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:48:24Z',
'fuel_type': 'diesel',
'id': 'b40f1f5a-9c45-5d8e-979d-8c1a0ccbcb13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH84704',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 79622,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-19',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH84704%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [auto1.fr] INFO: Saving data for TH84704: {'auction_closing_time': 1765039704.0, 'created_time': 1762277665.492029, 'last_price_update_time': 1764954186.578635}
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TH84704') HTTP/1.1" 204 0
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_3f5cc94cdec11a6d1fdbaaa7c82b06f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg not downloaded yet
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_1867b78974d87b55c44e089618694ae3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ56682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS81505> (referer: https://www.auto1.com/v1/car-details-view/VS81505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdd710>
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_15e9e84eb9299583eed685921d17a271.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_15e9e84eb9299583eed685921d17a271.jpg saved to cache
2025-12-05 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5877810>
2025-12-05 17:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_553d8f896bbad0b5a5c7f616e7b17791.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_553d8f896bbad0b5a5c7f616e7b17791.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_ca88887b85780cb15ef1803a826a1ef9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ca88887b85780cb15ef1803a826a1ef9.jpg not downloaded yet
2025-12-05 17:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL02911> (referer: https://www.auto1.com/v1/car-details-view/JL02911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f9a50>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_c08eb78c951ec2609836f9c953962f2a.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c08eb78c951ec2609836f9c953962f2a.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ea49ab1889a9f2056f4e923bae718bad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_84c471438a293483cdcdaaca759ade39.png> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_9cfe82ae0c751026c04a0714822146b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_c5e064d9dc6fb5a0d056e56d8eb58640.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_c5e064d9dc6fb5a0d056e56d8eb58640.jpg not downloaded yet
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c49d50>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_3f5cc94cdec11a6d1fdbaaa7c82b06f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_3f5cc94cdec11a6d1fdbaaa7c82b06f7.jpg saved to cache
2025-12-05 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd7e10>
2025-12-05 17:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_1867b78974d87b55c44e089618694ae3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_1867b78974d87b55c44e089618694ae3.jpg saved to cache
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ee32b8-e311-5002-b9b5-b0d8eb2eac74 with identifier: VS81505
2025-12-05 17:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ee32b8-e311-5002-b9b5-b0d8eb2eac74 with scrape type 2
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ee32b8-e311-5002-b9b5-b0d8eb2eac74 with scrape type 2
2025-12-05 17:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08ee32b8-e311-5002-b9b5-b0d8eb2eac74, identifier: VS81505
2025-12-05 17:03:08 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 95 pages/min), scraped 80 items (at 22 items/min)
2025-12-05 17:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08ee32b8-e311-5002-b9b5-b0d8eb2eac74 with identifier: VS81505
2025-12-05 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08ee32b8-e311-5002-b9b5-b0d8eb2eac74 with identifier: VS81505
2025-12-05 17:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08ee32b8-e311-5002-b9b5-b0d8eb2eac74 with identifier: VS81505 to the API
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VS81505>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:15:48Z',
'fuel_type': 'diesel',
'id': '08ee32b8-e311-5002-b9b5-b0d8eb2eac74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS81505',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Audi',
'model': 'Q5',
'odometer': 112665,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS81505%27 HTTP/1.1" 200 None
2025-12-05 17:03:08 [auto1.fr] INFO: Saving data for VS81505: {'auction_closing_time': 1765037748.0, 'created_time': 1762581625.674725, 'last_price_update_time': 1764954188.561383}
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS81505') HTTP/1.1" 204 0
2025-12-05 17:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29130076-1aef-54db-ac6a-5d6b8593caf7 with identifier: JL02911
2025-12-05 17:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29130076-1aef-54db-ac6a-5d6b8593caf7 with scrape type 2
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29130076-1aef-54db-ac6a-5d6b8593caf7 with scrape type 2
2025-12-05 17:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29130076-1aef-54db-ac6a-5d6b8593caf7, identifier: JL02911
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_014c719aef3f938f1a97ef7e1eeac7d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_10037e5815cca3466cf9b7ac273cd467.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_10037e5815cca3466cf9b7ac273cd467.jpg not downloaded yet
2025-12-05 17:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29130076-1aef-54db-ac6a-5d6b8593caf7 with identifier: JL02911
2025-12-05 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29130076-1aef-54db-ac6a-5d6b8593caf7 with identifier: JL02911
2025-12-05 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178581 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178581
2025-12-05 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29130076-1aef-54db-ac6a-5d6b8593caf7 spider: auto1.fr
2025-12-05 17:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 29130076-1aef-54db-ac6a-5d6b8593caf7 due to rule: high_mileage_for_country.json, error: 178581 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
178581
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:14:58Z',
'fuel_type': 'diesel',
'id': '29130076-1aef-54db-ac6a-5d6b8593caf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL02911',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 178581,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Confortline Business BlueMotion',
'transmission': 'automatic',
'trim': 'Confortline Business BlueMotion',
'year': 2017}
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL02911%27 HTTP/1.1" 200 None
2025-12-05 17:03:08 [auto1.fr] INFO: Saving data for JL02911: {'auction_closing_time': 1765037698.0, 'created_time': 1762339009.16889, 'last_price_update_time': 1764954188.910513}
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL02911') HTTP/1.1" 204 0
2025-12-05 17:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_d057bfd55c65a868a3359cb074fb97df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c590aad0>
2025-12-05 17:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_ea49ab1889a9f2056f4e923bae718bad.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ea49ab1889a9f2056f4e923bae718bad.jpg saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:03:09 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:03:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:03:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5936690>
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_15.png HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_84c471438a293483cdcdaaca759ade39.png') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_84c471438a293483cdcdaaca759ade39.png saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1ae50>
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_9cfe82ae0c751026c04a0714822146b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_9cfe82ae0c751026c04a0714822146b4.jpg saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_8987f2737ae9458853cf264ec2805065.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_8987f2737ae9458853cf264ec2805065.jpg not downloaded yet
2025-12-05 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR41069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_88747d4e29da210ecd57a4da458390c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ca88887b85780cb15ef1803a826a1ef9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5988d90>
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_014c719aef3f938f1a97ef7e1eeac7d5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_014c719aef3f938f1a97ef7e1eeac7d5.jpg saved to cache
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_4799d9b1606de7e06dedc5d6034c3597.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_4799d9b1606de7e06dedc5d6034c3597.jpg not downloaded yet
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578d090>
2025-12-05 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_d057bfd55c65a868a3359cb074fb97df.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_d057bfd55c65a868a3359cb074fb97df.jpg saved to cache
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_c5e064d9dc6fb5a0d056e56d8eb58640.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_fb3bb95cd1c3b34ced2562d8636a33ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_fb3bb95cd1c3b34ced2562d8636a33ef.jpg not downloaded yet
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f075d0>
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_88747d4e29da210ecd57a4da458390c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_88747d4e29da210ecd57a4da458390c6.jpg saved to cache
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a663d0>
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_ca88887b85780cb15ef1803a826a1ef9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ca88887b85780cb15ef1803a826a1ef9.jpg saved to cache
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_10037e5815cca3466cf9b7ac273cd467.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_01e7518ebedd17e164c1cf2284263a7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_2b179398bfaf7abf3c0b3303d4d28083.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_2b179398bfaf7abf3c0b3303d4d28083.jpg not downloaded yet
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD69893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK67135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL50485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL41692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF49418> (referer: https://www.auto1.com/v1/car-details-view/JF49418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP09504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f2910>
2025-12-05 17:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_c5e064d9dc6fb5a0d056e56d8eb58640.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_c5e064d9dc6fb5a0d056e56d8eb58640.jpg saved to cache
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_34b0c4b94d95206ea271b7571a26f243.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_34b0c4b94d95206ea271b7571a26f243.png not downloaded yet
2025-12-05 17:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_4799d9b1606de7e06dedc5d6034c3597.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB05598> (referer: https://www.auto1.com/v1/car-details-view/NB05598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d94550>
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_10037e5815cca3466cf9b7ac273cd467.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_10037e5815cca3466cf9b7ac273cd467.jpg saved to cache
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d94590>
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_01e7518ebedd17e164c1cf2284263a7e.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_01e7518ebedd17e164c1cf2284263a7e.jpg saved to cache
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8896c9b2-01e6-534e-a556-67c6aa17202c with identifier: JF49418
2025-12-05 17:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8896c9b2-01e6-534e-a556-67c6aa17202c with scrape type 2
2025-12-05 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8896c9b2-01e6-534e-a556-67c6aa17202c with scrape type 2
2025-12-05 17:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8896c9b2-01e6-534e-a556-67c6aa17202c, identifier: JF49418
2025-12-05 17:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8896c9b2-01e6-534e-a556-67c6aa17202c with identifier: JF49418
2025-12-05 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8896c9b2-01e6-534e-a556-67c6aa17202c with identifier: JF49418
2025-12-05 17:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8896c9b2-01e6-534e-a556-67c6aa17202c with identifier: JF49418 to the API
2025-12-05 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF49418>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:27:36Z',
'fuel_type': 'diesel',
'id': '8896c9b2-01e6-534e-a556-67c6aa17202c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF49418',
'listing': 'auction',
'location': 'Reims',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 79160,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF49418%27 HTTP/1.1" 200 None
2025-12-05 17:03:12 [auto1.fr] INFO: Saving data for JF49418: {'auction_closing_time': 1765038456.0, 'created_time': 1764756206.259536, 'last_price_update_time': 1764954192.17212}
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JF49418') HTTP/1.1" 204 0
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_fb3bb95cd1c3b34ced2562d8636a33ef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_8987f2737ae9458853cf264ec2805065.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_2b179398bfaf7abf3c0b3303d4d28083.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ24789> (referer: https://www.auto1.com/v1/car-details-view/EZ24789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_d371fccfe35ff0fe048b0206f2bdfb7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579eb10>
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_4799d9b1606de7e06dedc5d6034c3597.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_4799d9b1606de7e06dedc5d6034c3597.jpg saved to cache
2025-12-05 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc with identifier: NB05598
2025-12-05 17:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc with scrape type 2
2025-12-05 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc with scrape type 2
2025-12-05 17:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc, identifier: NB05598
2025-12-05 17:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc with identifier: NB05598
2025-12-05 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc with identifier: NB05598
2025-12-05 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 12193, 'odometer_reading_unit': 'km', 'registration_date': '2023-12-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nb05598', 'expiration_date': '2025-12-06t16:41:55z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc', 'current_year_diff': 2, 'age_in_months': 23, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 12193}
Failed validating None in schema:
False
On instance:
{'age_in_months': 23,
'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:41:55z',
'fuel_type': 'petrol',
'id': '76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nb05598',
'listing': 'auction',
'location': 'fr, warluis',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 12193,
'odometer_in_km': 12193,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-21',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
2025-12-05 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc spider: auto1.fr
2025-12-05 17:03:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 12193, 'odometer_reading_unit': 'km', 'registration_date': '2023-12-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nb05598', 'expiration_date': '2025-12-06t16:41:55z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc', 'current_year_diff': 2, 'age_in_months': 23, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 12193}
Failed validating None in schema:
False
On instance:
{'age_in_months': 23,
'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:41:55z',
'fuel_type': 'petrol',
'id': '76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nb05598',
'listing': 'auction',
'location': 'fr, warluis',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 12193,
'odometer_in_km': 12193,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-21',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:41:55Z',
'fuel_type': 'petrol',
'id': '76b2a47b-7ca2-5d9b-8df6-b959dcedfcfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB05598',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Peugeot',
'model': '308',
'odometer': 12193,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB05598%27 HTTP/1.1" 200 None
2025-12-05 17:03:12 [auto1.fr] INFO: Saving data for NB05598: {'auction_closing_time': 1765039315.0, 'created_time': 1764756181.736583, 'last_price_update_time': 1764954192.806107}
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NB05598') HTTP/1.1" 204 0
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_11ff0e966ead3495dbad7e87f72216e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_34b0c4b94d95206ea271b7571a26f243.png> (referer: https://www.auto1.com/)
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d77510>
2025-12-05 17:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_fb3bb95cd1c3b34ced2562d8636a33ef.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_fb3bb95cd1c3b34ced2562d8636a33ef.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd4c10>
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_8987f2737ae9458853cf264ec2805065.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_8987f2737ae9458853cf264ec2805065.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd57d0>
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_2b179398bfaf7abf3c0b3303d4d28083.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_2b179398bfaf7abf3c0b3303d4d28083.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0932697a-a36f-5297-82e3-9b625a75d9ff with identifier: EZ24789
2025-12-05 17:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0932697a-a36f-5297-82e3-9b625a75d9ff with scrape type 2
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0932697a-a36f-5297-82e3-9b625a75d9ff with scrape type 2
2025-12-05 17:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0932697a-a36f-5297-82e3-9b625a75d9ff, identifier: EZ24789
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cf310>
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_d371fccfe35ff0fe048b0206f2bdfb7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_d371fccfe35ff0fe048b0206f2bdfb7b.jpg saved to cache
2025-12-05 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0932697a-a36f-5297-82e3-9b625a75d9ff with identifier: EZ24789
2025-12-05 17:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0932697a-a36f-5297-82e3-9b625a75d9ff with identifier: EZ24789
2025-12-05 17:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195522 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195522
2025-12-05 17:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0932697a-a36f-5297-82e3-9b625a75d9ff spider: auto1.fr
2025-12-05 17:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0932697a-a36f-5297-82e3-9b625a75d9ff due to rule: high_mileage_for_country.json, error: 195522 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
195522
{'auction_title': '',
'c_o_2_emission_value': 61,
'category': 'Taxi',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 392,
'expiration_date': '2025-12-06T16:53:32Z',
'fuel_type': 'hybrid',
'id': '0932697a-a36f-5297-82e3-9b625a75d9ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ24789',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Volvo',
'model': 'XC90',
'odometer': 195522,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-26',
'seats_number': 7,
'seller_name': None,
'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription Expression AWD',
'transmission': 'automatic',
'trim': 'Inscription Expression AWD',
'year': 2020}
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ24789%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [auto1.fr] INFO: Saving data for EZ24789: {'auction_closing_time': 1765040012.0, 'created_time': 1764756332.950158, 'last_price_update_time': 1764954194.103617}
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ24789') HTTP/1.1" 204 0
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_30eca362a36a2ebed4af7e9217d60729.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB34017> (referer: https://www.auto1.com/v1/car-details-view/JB34017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR41069> (referer: https://www.auto1.com/v1/car-details-view/UR41069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT59463> (referer: https://www.auto1.com/v1/car-details-view/UT59463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ56682> (referer: https://www.auto1.com/v1/car-details-view/BJ56682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a08890>
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_11ff0e966ead3495dbad7e87f72216e4.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_11ff0e966ead3495dbad7e87f72216e4.jpg saved to cache
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:14 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:03:14 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:03:14 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:03:14 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7c11710>
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_15.png HTTP/1.1" 201 0
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_34b0c4b94d95206ea271b7571a26f243.png') HTTP/1.1" 204 0
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_34b0c4b94d95206ea271b7571a26f243.png saved to cache
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_acb96ffb07c59bb7e8b69e1f181597e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_292eb9acb1af6d3d682dcc4cff85fbff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5828990>
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_30eca362a36a2ebed4af7e9217d60729.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_30eca362a36a2ebed4af7e9217d60729.jpg saved to cache
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5506abe0-977f-5628-a004-b8369fc2b3ed with identifier: JB34017
2025-12-05 17:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5506abe0-977f-5628-a004-b8369fc2b3ed with scrape type 1
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_0f6fa10d1616e80511a0cb3cfa963174.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_0f6fa10d1616e80511a0cb3cfa963174.jpg not downloaded yet
2025-12-05 17:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 with identifier: UR41069
2025-12-05 17:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 with scrape type 2
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 with scrape type 2
2025-12-05 17:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95, identifier: UR41069
2025-12-05 17:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870 with identifier: UT59463
2025-12-05 17:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870 with scrape type 2
2025-12-05 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870 with scrape type 2
2025-12-05 17:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870, identifier: UT59463
2025-12-05 17:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce3597c-487e-5bf1-a359-20b75a98fd84 with identifier: BJ56682
2025-12-05 17:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce3597c-487e-5bf1-a359-20b75a98fd84 with scrape type 2
2025-12-05 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce3597c-487e-5bf1-a359-20b75a98fd84 with scrape type 2
2025-12-05 17:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ce3597c-487e-5bf1-a359-20b75a98fd84, identifier: BJ56682
2025-12-05 17:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 with identifier: UR41069
2025-12-05 17:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 with identifier: UR41069
2025-12-05 17:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy wave', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'automatic', 'odometer': 172760, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ur41069', 'expiration_date': '2025-12-06t16:09:01z', 'origin_country_code': 'fr', 'trim': 'wave', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 172760}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 120,
'expiration_date': '2025-12-06t16:09:01z',
'fuel_type': 'petrol',
'id': '5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ur41069',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'renault',
'make_model': 'renault captur',
'model': 'captur',
'odometer': 172760,
'odometer_in_km': 172760,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-27',
'sanitized_make': 'renault',
'seats_number': 5,
'seller_name': None,
'title': 'renault captur 1.2 tce energy wave',
'transmission': 'automatic',
'trim': 'wave',
'year': 2016}
2025-12-05 17:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 spider: auto1.fr
2025-12-05 17:03:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy wave', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'automatic', 'odometer': 172760, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ur41069', 'expiration_date': '2025-12-06t16:09:01z', 'origin_country_code': 'fr', 'trim': 'wave', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 172760}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 120,
'expiration_date': '2025-12-06t16:09:01z',
'fuel_type': 'petrol',
'id': '5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ur41069',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'renault',
'make_model': 'renault captur',
'model': 'captur',
'odometer': 172760,
'odometer_in_km': 172760,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-27',
'sanitized_make': 'renault',
'seats_number': 5,
'seller_name': None,
'title': 'renault captur 1.2 tce energy wave',
'transmission': 'automatic',
'trim': 'wave',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:09:01Z',
'fuel_type': 'petrol',
'id': '5a2c80f7-e8b9-5b87-9ea4-d886e91ccd95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR41069',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Renault',
'model': 'Captur',
'odometer': 172760,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.2 TCe Energy Wave',
'transmission': 'automatic',
'trim': 'Wave',
'year': 2016}
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR41069%27 HTTP/1.1" 200 None
2025-12-05 17:03:15 [auto1.fr] INFO: Saving data for UR41069: {'auction_closing_time': 1765037341.0, 'created_time': 1764756204.036549, 'last_price_update_time': 1764954195.354115}
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UR41069') HTTP/1.1" 204 0
2025-12-05 17:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870 with identifier: UT59463
2025-12-05 17:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870 with identifier: UT59463
2025-12-05 17:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870 with identifier: UT59463 to the API
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT59463>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:51:01Z',
'fuel_type': 'diesel',
'id': 'b91dd40a-d57a-5b0d-ac12-0aaf1e5a8870',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT59463',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 119973,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-31',
'seats_number': 7,
'seller_name': None,
'title': 'Renault Grand Scenic 1.7 BLUE dCi Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2019}
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT59463%27 HTTP/1.1" 200 None
2025-12-05 17:03:15 [auto1.fr] INFO: Saving data for UT59463: {'auction_closing_time': 1765039861.0, 'created_time': 1764756434.231724, 'last_price_update_time': 1764954195.680908}
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT59463') HTTP/1.1" 204 0
2025-12-05 17:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ce3597c-487e-5bf1-a359-20b75a98fd84 with identifier: BJ56682
2025-12-05 17:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ce3597c-487e-5bf1-a359-20b75a98fd84 with identifier: BJ56682
2025-12-05 17:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ce3597c-487e-5bf1-a359-20b75a98fd84 with identifier: BJ56682 to the API
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ56682>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:42:53Z',
'fuel_type': 'petrol',
'id': '3ce3597c-487e-5bf1-a359-20b75a98fd84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ56682',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Fiat',
'model': '500X',
'odometer': 65999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2017}
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ56682%27 HTTP/1.1" 200 None
2025-12-05 17:03:15 [auto1.fr] INFO: Saving data for BJ56682: {'auction_closing_time': 1765039373.0, 'created_time': 1764756469.435383, 'last_price_update_time': 1764954195.980085}
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BJ56682') HTTP/1.1" 204 0
2025-12-05 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_7d0e3e4ca3c3e710fa1b891c1898247c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_2b6a658742da77b234890820f8804f09.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2b6a658742da77b234890820f8804f09.jpg not downloaded yet
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_9968920655eeee59192a00c66f602bab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL41692> (referer: https://www.auto1.com/v1/car-details-view/XL41692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK67135> (referer: https://www.auto1.com/v1/car-details-view/ZK67135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP09504> (referer: https://www.auto1.com/v1/car-details-view/BP09504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL50485> (referer: https://www.auto1.com/v1/car-details-view/LL50485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_aaa0aa0c6ad1e9736907ae0b1288b61b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_3a774730a63e642b39e20e2fc1115337.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3a774730a63e642b39e20e2fc1115337.jpg not downloaded yet
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f5f90>
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_acb96ffb07c59bb7e8b69e1f181597e9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_acb96ffb07c59bb7e8b69e1f181597e9.jpg saved to cache
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a67890>
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_292eb9acb1af6d3d682dcc4cff85fbff.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_292eb9acb1af6d3d682dcc4cff85fbff.jpg saved to cache
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_ffaa0696332a63572e337af077fa9702.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ffaa0696332a63572e337af077fa9702.jpg not downloaded yet
2025-12-05 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_0c88bbfd5de352c68c3efde4fba77612.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7e790>
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_7d0e3e4ca3c3e710fa1b891c1898247c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_7d0e3e4ca3c3e710fa1b891c1898247c.jpg saved to cache
2025-12-05 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd0990>
2025-12-05 17:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_9968920655eeee59192a00c66f602bab.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_9968920655eeee59192a00c66f602bab.jpg saved to cache
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed20c51-7272-5fb1-a337-87a1371c0228 with identifier: XL41692
2025-12-05 17:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed20c51-7272-5fb1-a337-87a1371c0228 with scrape type 1
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_aab15054423deff046d4d45990ea1814.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg not downloaded yet
2025-12-05 17:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831 with identifier: ZK67135
2025-12-05 17:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831 with scrape type 2
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831 with scrape type 2
2025-12-05 17:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831, identifier: ZK67135
2025-12-05 17:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975fca6f-2d17-519d-a495-c6963f0572e5 with identifier: BP09504
2025-12-05 17:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975fca6f-2d17-519d-a495-c6963f0572e5 with scrape type 2
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 975fca6f-2d17-519d-a495-c6963f0572e5 with scrape type 2
2025-12-05 17:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 975fca6f-2d17-519d-a495-c6963f0572e5, identifier: BP09504
2025-12-05 17:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2317388-05dc-5a54-9871-f9f8b1a4984f with identifier: LL50485
2025-12-05 17:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2317388-05dc-5a54-9871-f9f8b1a4984f with scrape type 2
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2317388-05dc-5a54-9871-f9f8b1a4984f with scrape type 2
2025-12-05 17:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2317388-05dc-5a54-9871-f9f8b1a4984f, identifier: LL50485
2025-12-05 17:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7b44850>
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_aaa0aa0c6ad1e9736907ae0b1288b61b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_aaa0aa0c6ad1e9736907ae0b1288b61b.jpg saved to cache
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_cb7fd505ce8ae427b3b761ae32588443.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_cb7fd505ce8ae427b3b761ae32588443.jpg not downloaded yet
2025-12-05 17:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831 with identifier: ZK67135
2025-12-05 17:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831 with identifier: ZK67135
2025-12-05 17:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831 with identifier: ZK67135 to the API
2025-12-05 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK67135>
{'auction_title': '',
'c_o_2_emission_value': 51,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 320,
'expiration_date': '2025-12-06T16:52:08Z',
'fuel_type': 'hybrid',
'id': 'a6f8cc9c-e0b3-5aae-aef1-70c8e65ac831',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK67135',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 122670,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK67135%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [auto1.fr] INFO: Saving data for ZK67135: {'auction_closing_time': 1765039928.0, 'created_time': 1764842631.684716, 'last_price_update_time': 1764954198.172757}
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZK67135') HTTP/1.1" 204 0
2025-12-05 17:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 975fca6f-2d17-519d-a495-c6963f0572e5 with identifier: BP09504
2025-12-05 17:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 975fca6f-2d17-519d-a495-c6963f0572e5 with identifier: BP09504
2025-12-05 17:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 975fca6f-2d17-519d-a495-c6963f0572e5 with identifier: BP09504 to the API
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP09504>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 184,
'expiration_date': '2025-12-06T16:07:14Z',
'fuel_type': 'electro',
'id': '975fca6f-2d17-519d-a495-c6963f0572e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP09504',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'MINI',
'model': 'MINI',
'odometer': 49776,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-11',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper SE Essential Trim',
'transmission': 'automatic',
'trim': 'Essential Trim',
'year': 2021}
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP09504%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [auto1.fr] INFO: Saving data for BP09504: {'auction_closing_time': 1765037234.0, 'created_time': 1764223379.410424, 'last_price_update_time': 1764954198.470177}
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BP09504') HTTP/1.1" 204 0
2025-12-05 17:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2317388-05dc-5a54-9871-f9f8b1a4984f with identifier: LL50485
2025-12-05 17:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2317388-05dc-5a54-9871-f9f8b1a4984f with identifier: LL50485
2025-12-05 17:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2317388-05dc-5a54-9871-f9f8b1a4984f with identifier: LL50485 to the API
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LL50485>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:51:13Z',
'fuel_type': 'petrol',
'id': 'c2317388-05dc-5a54-9871-f9f8b1a4984f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL50485',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Honda',
'model': 'Jazz',
'odometer': 32447,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.5 i-VTEC Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2019}
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL50485%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [auto1.fr] INFO: Saving data for LL50485: {'auction_closing_time': 1765039873.0, 'created_time': 1764781307.740106, 'last_price_update_time': 1764954198.771983}
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL50485') HTTP/1.1" 204 0
2025-12-05 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_0f6fa10d1616e80511a0cb3cfa963174.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_7dd360e4d5ab3f69b079244692026cca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg not downloaded yet
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_9345fbc7097cce9e621858d6b6ac66d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_9345fbc7097cce9e621858d6b6ac66d9.jpg not downloaded yet
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD69893> (referer: https://www.auto1.com/v1/car-details-view/FD69893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB30368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c589a4d0>
2025-12-05 17:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_0c88bbfd5de352c68c3efde4fba77612.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_0c88bbfd5de352c68c3efde4fba77612.jpg saved to cache
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg not downloaded yet
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3a774730a63e642b39e20e2fc1115337.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_950d6cd552aae858a88a6e94d708d97d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_950d6cd552aae858a88a6e94d708d97d.jpg not downloaded yet
2025-12-05 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ffaa0696332a63572e337af077fa9702.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg not downloaded yet
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg not downloaded yet
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg not downloaded yet
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d0b450>
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_0f6fa10d1616e80511a0cb3cfa963174.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_0f6fa10d1616e80511a0cb3cfa963174.jpg saved to cache
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03b1bcc0-44d7-5a24-8067-b204bc837b15 with identifier: FD69893
2025-12-05 17:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03b1bcc0-44d7-5a24-8067-b204bc837b15 with scrape type 2
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03b1bcc0-44d7-5a24-8067-b204bc837b15 with scrape type 2
2025-12-05 17:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03b1bcc0-44d7-5a24-8067-b204bc837b15, identifier: FD69893
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2b6a658742da77b234890820f8804f09.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_86f073539b44b6cee2914de40fdc2699.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_2ad90fdec903a9115a87c43ea3fba900.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2ad90fdec903a9115a87c43ea3fba900.jpg not downloaded yet
2025-12-05 17:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03b1bcc0-44d7-5a24-8067-b204bc837b15 with identifier: FD69893
2025-12-05 17:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03b1bcc0-44d7-5a24-8067-b204bc837b15 with identifier: FD69893
2025-12-05 17:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03b1bcc0-44d7-5a24-8067-b204bc837b15 with identifier: FD69893 to the API
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD69893>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:33:31Z',
'fuel_type': 'diesel',
'id': '03b1bcc0-44d7-5a24-8067-b204bc837b15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD69893',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'BMW',
'model': '5er',
'odometer': 112218,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d xDrive Lounge',
'transmission': 'automatic',
'trim': 'xDrive Lounge',
'year': 2016}
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD69893%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [auto1.fr] INFO: Saving data for FD69893: {'auction_closing_time': 1765038811.0, 'created_time': 1764435718.158003, 'last_price_update_time': 1764954199.869794}
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FD69893') HTTP/1.1" 204 0
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg not downloaded yet
2025-12-05 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a5c50>
2025-12-05 17:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F60%252Fdc606fc2e82f9e9cc7368aa627c9adfe%252Fpa%252FXE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg saved to cache
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc
2025-12-05 17:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc, skipping ID generation
2025-12-05 17:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc with scrape type 1
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc from tracking dictionaries
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc sending to next pipeline
2025-12-05 17:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc, identifier: XE12078
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_5b594c27ae23758bcb0721a966cfa485.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_5b594c27ae23758bcb0721a966cfa485.jpg not downloaded yet
2025-12-05 17:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc with identifier: XE12078
2025-12-05 17:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc with identifier: XE12078
2025-12-05 17:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7d5fb03f-f021-5a85-b4b9-54dabd71a6fc with identifier: XE12078 to the API
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2025-12-06T16:57:43Z',
'fuel_type': 'petrol',
'id': '7d5fb03f-f021-5a85-b4b9-54dabd71a6fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE12078',
'listing': 'auction',
'location': 'FR, Villeneuve-lès-Béziers',
'make': 'Renault',
'model': 'Captur',
'odometer': 71041,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_d371fccfe35ff0fe048b0206f2bdfb7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_88747d4e29da210ecd57a4da458390c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_1867b78974d87b55c44e089618694ae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_014c719aef3f938f1a97ef7e1eeac7d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_9cfe82ae0c751026c04a0714822146b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2312825,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_aaa0aa0c6ad1e9736907ae0b1288b61b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ea49ab1889a9f2056f4e923bae718bad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2560590,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_e7dc2b7281d8a9c90674f3921abdc6ca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_ca88887b85780cb15ef1803a826a1ef9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_c5e064d9dc6fb5a0d056e56d8eb58640.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_10037e5815cca3466cf9b7ac273cd467.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_8987f2737ae9458853cf264ec2805065.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_4799d9b1606de7e06dedc5d6034c3597.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_fb3bb95cd1c3b34ced2562d8636a33ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_2b179398bfaf7abf3c0b3303d4d28083.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5fb03f-f021-5a85-b4b9-54dabd71a6fc/7d5fb03f-f021-5a85-b4b9-54dabd71a6fc_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 81517,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/60/dc606fc2e82f9e9cc7368aa627c9adfe/pa/XE12078_34b0c4b94d95206ea271b7571a26f243.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE12078%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [auto1.fr] INFO: Saving data for XE12078: {'created_time': 1764954200.66704, 'last_price_update_time': 1764954200.667052, 'auction_closing_time': 1765040263.0}
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XE12078') HTTP/1.1" 204 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_6f992b301014dbeb4bbf2b4b65859331.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg not downloaded yet
2025-12-05 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c8e3ed6cafa8f20e62789fb20f5714ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_3520db0778a7702941580b610d2728fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3520db0778a7702941580b610d2728fa.jpg not downloaded yet
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5813c10>
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_3a774730a63e642b39e20e2fc1115337.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3a774730a63e642b39e20e2fc1115337.jpg saved to cache
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b08d0>
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_ffaa0696332a63572e337af077fa9702.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ffaa0696332a63572e337af077fa9702.jpg saved to cache
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cac050>
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_2b6a658742da77b234890820f8804f09.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2b6a658742da77b234890820f8804f09.jpg saved to cache
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7b650>
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_86f073539b44b6cee2914de40fdc2699.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_86f073539b44b6cee2914de40fdc2699.jpg saved to cache
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f0845d5831c6010a7ca201568bf3928b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_f3e9b476fd91ab07511fe60d9848de51.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg not downloaded yet
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_17ce6c96d10f4f7a7ddf00f8353fa250.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_17ce6c96d10f4f7a7ddf00f8353fa250.jpg not downloaded yet
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg not downloaded yet
2025-12-05 17:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0d010>
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_c8e3ed6cafa8f20e62789fb20f5714ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c8e3ed6cafa8f20e62789fb20f5714ba.jpg saved to cache
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb75d0>
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_aab15054423deff046d4d45990ea1814.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg saved to cache
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_cb7fd505ce8ae427b3b761ae32588443.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_bb5880ca54a7a6b35ff440bd6362001a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_bb5880ca54a7a6b35ff440bd6362001a.jpg not downloaded yet
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_1ecda753eb267fae2b61c8d2662a681f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_093669b1e808ec1af12fc8dfdbfc92d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_093669b1e808ec1af12fc8dfdbfc92d3.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_78772bbfcda9924f8b1e92389de1edcc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_78772bbfcda9924f8b1e92389de1edcc.jpg not downloaded yet
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df5cd0>
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_f0845d5831c6010a7ca201568bf3928b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f0845d5831c6010a7ca201568bf3928b.jpg saved to cache
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_4a454e437c57683b37f621f07ac823ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg not downloaded yet
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_d2b7be0e3b8fb50ca80c32d5b3a89ef9.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_d2b7be0e3b8fb50ca80c32d5b3a89ef9.png not downloaded yet
2025-12-05 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_9662b570d2918aa2a455d0289233ce32.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg not downloaded yet
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_bfe79c222f4079545903cc65e7a48554.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg not downloaded yet
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d77a10>
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_cb7fd505ce8ae427b3b761ae32588443.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_cb7fd505ce8ae427b3b761ae32588443.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c61ed0>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_7dd360e4d5ab3f69b079244692026cca.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB30368> (referer: https://www.auto1.com/v1/car-details-view/LB30368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_127d886e1cba31f5dcd03cba55df42d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg not downloaded yet
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3520db0778a7702941580b610d2728fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC03144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ57263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_4e4cef313b61afe5b0d81ee991f8b74b.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png not downloaded yet
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d024d0>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e65a10>
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg saved to cache
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_4b6465312ba104612974b11cc1d09c15.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_5b594c27ae23758bcb0721a966cfa485.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_718a24e2789d75184d1fcf6659a3adb5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1b15a6e-883e-5382-9710-305155badf03 with identifier: LB30368
2025-12-05 17:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b15a6e-883e-5382-9710-305155badf03 with scrape type 2
2025-12-05 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1b15a6e-883e-5382-9710-305155badf03 with scrape type 2
2025-12-05 17:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1b15a6e-883e-5382-9710-305155badf03, identifier: LB30368
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585fe90>
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_6f992b301014dbeb4bbf2b4b65859331.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg saved to cache
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c91bd0>
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_3520db0778a7702941580b610d2728fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3520db0778a7702941580b610d2728fa.jpg saved to cache
2025-12-05 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1b15a6e-883e-5382-9710-305155badf03 with identifier: LB30368
2025-12-05 17:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1b15a6e-883e-5382-9710-305155badf03 with identifier: LB30368
2025-12-05 17:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 50614, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb30368', 'expiration_date': '2025-12-06t16:25:30z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'a1b15a6e-883e-5382-9710-305155badf03', 'current_year_diff': 4, 'age_in_months': 57, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 50614}
Failed validating None in schema:
False
On instance:
{'age_in_months': 57,
'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:25:30z',
'fuel_type': 'petrol',
'id': 'a1b15a6e-883e-5382-9710-305155badf03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb30368',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 50614,
'odometer_in_km': 50614,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-16',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2021}
2025-12-05 17:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a1b15a6e-883e-5382-9710-305155badf03 spider: auto1.fr
2025-12-05 17:03:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a1b15a6e-883e-5382-9710-305155badf03 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 50614, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb30368', 'expiration_date': '2025-12-06t16:25:30z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'a1b15a6e-883e-5382-9710-305155badf03', 'current_year_diff': 4, 'age_in_months': 57, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 50614}
Failed validating None in schema:
False
On instance:
{'age_in_months': 57,
'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:25:30z',
'fuel_type': 'petrol',
'id': 'a1b15a6e-883e-5382-9710-305155badf03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb30368',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 50614,
'odometer_in_km': 50614,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-16',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:25:30Z',
'fuel_type': 'petrol',
'id': 'a1b15a6e-883e-5382-9710-305155badf03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB30368',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Peugeot',
'model': '208',
'odometer': 50614,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2021}
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB30368%27 HTTP/1.1" 200 None
2025-12-05 17:03:24 [auto1.fr] INFO: Saving data for LB30368: {'auction_closing_time': 1765038330.0, 'created_time': 1763658380.849881, 'last_price_update_time': 1764954204.718412}
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LB30368') HTTP/1.1" 204 0
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_eb02196182de6d7fb9f2883a23893153.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_78772bbfcda9924f8b1e92389de1edcc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dff890>
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_4b6465312ba104612974b11cc1d09c15.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_4b6465312ba104612974b11cc1d09c15.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57dde50>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_5b594c27ae23758bcb0721a966cfa485.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_5b594c27ae23758bcb0721a966cfa485.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5892b90>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5883050>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_718a24e2789d75184d1fcf6659a3adb5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_718a24e2789d75184d1fcf6659a3adb5.jpg saved to cache
2025-12-05 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_dcb65ffcab95d86fece6d4636b9e783b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_d2b7be0e3b8fb50ca80c32d5b3a89ef9.png> (referer: https://www.auto1.com/)
2025-12-05 17:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ded190>
2025-12-05 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_eb02196182de6d7fb9f2883a23893153.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_eb02196182de6d7fb9f2883a23893153.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ee7c50>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_4a454e437c57683b37f621f07ac823ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f04650>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_bfe79c222f4079545903cc65e7a48554.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da9f50>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_78772bbfcda9924f8b1e92389de1edcc.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_78772bbfcda9924f8b1e92389de1edcc.jpg saved to cache
2025-12-05 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ee5cd0>
2025-12-05 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_dcb65ffcab95d86fece6d4636b9e783b.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_dcb65ffcab95d86fece6d4636b9e783b.jpg saved to cache
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c82f50>
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_9662b570d2918aa2a455d0289233ce32.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg saved to cache
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:27 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:03:27 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:03:27 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:03:27 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdf050>
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_15.png HTTP/1.1" 201 0
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_d2b7be0e3b8fb50ca80c32d5b3a89ef9.png') HTTP/1.1" 204 0
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_d2b7be0e3b8fb50ca80c32d5b3a89ef9.png saved to cache
2025-12-05 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_bbd11c80e76b0545499717f940ef769d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_bb5880ca54a7a6b35ff440bd6362001a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png> (referer: https://www.auto1.com/)
2025-12-05 17:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ee7550>
2025-12-05 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cfbe50>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_127d886e1cba31f5dcd03cba55df42d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2ad90fdec903a9115a87c43ea3fba900.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1d910>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_f3e9b476fd91ab07511fe60d9848de51.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d77590>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_1ecda753eb267fae2b61c8d2662a681f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg saved to cache
2025-12-05 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de2c50>
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_bbd11c80e76b0545499717f940ef769d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_bbd11c80e76b0545499717f940ef769d.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c98290>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_bb5880ca54a7a6b35ff440bd6362001a.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_bb5880ca54a7a6b35ff440bd6362001a.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:03:29 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:03:29 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:03:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579e690>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_15.png HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_4e4cef313b61afe5b0d81ee991f8b74b.png') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f00bd4b23cc6c1f11dca76ff3af9fce0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e12692da1799384bf54c2483acf37083.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_950d6cd552aae858a88a6e94d708d97d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ57263> (referer: https://www.auto1.com/v1/car-details-view/UZ57263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC03144> (referer: https://www.auto1.com/v1/car-details-view/HC03144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d32d0>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg saved to cache
2025-12-05 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4daa750>
2025-12-05 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_2ad90fdec903a9115a87c43ea3fba900.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2ad90fdec903a9115a87c43ea3fba900.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_36fd5607bdaff39b5c45c8e3a3ad1a48.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_46cf5868d0d6712a61f854c7a085e1d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e33f10>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_f00bd4b23cc6c1f11dca76ff3af9fce0.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f00bd4b23cc6c1f11dca76ff3af9fce0.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5ddd0>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F93%252F69939523cd17e053ede5f1e50a2009b7%252Fpa%252FXL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg saved to cache
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ed20c51-7272-5fb1-a337-87a1371c0228
2025-12-05 17:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ed20c51-7272-5fb1-a337-87a1371c0228, skipping ID generation
2025-12-05 17:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed20c51-7272-5fb1-a337-87a1371c0228 with scrape type 1
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0ed20c51-7272-5fb1-a337-87a1371c0228 from tracking dictionaries
2025-12-05 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ed20c51-7272-5fb1-a337-87a1371c0228 sending to next pipeline
2025-12-05 17:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0ed20c51-7272-5fb1-a337-87a1371c0228, identifier: XL41692
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59d8590>
2025-12-05 17:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_e12692da1799384bf54c2483acf37083.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e12692da1799384bf54c2483acf37083.jpg saved to cache
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb5850>
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_950d6cd552aae858a88a6e94d708d97d.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_950d6cd552aae858a88a6e94d708d97d.jpg saved to cache
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03eae1ac-df8c-59c6-a6eb-ded3f93334c9 with identifier: UZ57263
2025-12-05 17:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03eae1ac-df8c-59c6-a6eb-ded3f93334c9 with scrape type 2
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03eae1ac-df8c-59c6-a6eb-ded3f93334c9 with scrape type 2
2025-12-05 17:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03eae1ac-df8c-59c6-a6eb-ded3f93334c9, identifier: UZ57263
2025-12-05 17:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70f9061e-89af-5c71-aa85-ea154b3f56c9 with identifier: HC03144
2025-12-05 17:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70f9061e-89af-5c71-aa85-ea154b3f56c9 with scrape type 2
2025-12-05 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70f9061e-89af-5c71-aa85-ea154b3f56c9 with scrape type 2
2025-12-05 17:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70f9061e-89af-5c71-aa85-ea154b3f56c9, identifier: HC03144
2025-12-05 17:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_9345fbc7097cce9e621858d6b6ac66d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0ed20c51-7272-5fb1-a337-87a1371c0228 with identifier: XL41692
2025-12-05 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0ed20c51-7272-5fb1-a337-87a1371c0228 with identifier: XL41692
2025-12-05 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 70221, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl41692', 'expiration_date': '2025-12-06t16:51:19z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, besançon', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '0ed20c51-7272-5fb1-a337-87a1371c0228', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53481}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50048}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52710}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66117}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53470}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58778}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48034}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54464}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 25471}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 70779}], 'current_year_diff': 6, 'age_in_months': 80, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70221}
Failed validating None in schema:
False
On instance:
{'age_in_months': 80,
'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 68,
'expiration_date': '2025-12-06t16:51:19z',
'fuel_type': 'petrol',
'id': '0ed20c51-7272-5fb1-a337-87a1371c0228',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl41692',
'listing': 'auction',
'location': 'fr, besançon',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 70221,
'odometer_in_km': 70221,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70779,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-21',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech like',
'transmission': 'manual',
'trim': 'like',
'year': 2019}
2025-12-05 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0ed20c51-7272-5fb1-a337-87a1371c0228 spider: auto1.fr
2025-12-05 17:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0ed20c51-7272-5fb1-a337-87a1371c0228 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 70221, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl41692', 'expiration_date': '2025-12-06t16:51:19z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, besançon', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '0ed20c51-7272-5fb1-a337-87a1371c0228', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53481}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50048}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52710}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66117}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53470}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58778}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48034}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54464}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 25471}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 70779}], 'current_year_diff': 6, 'age_in_months': 80, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70221}
Failed validating None in schema:
False
On instance:
{'age_in_months': 80,
'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 68,
'expiration_date': '2025-12-06t16:51:19z',
'fuel_type': 'petrol',
'id': '0ed20c51-7272-5fb1-a337-87a1371c0228',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl41692',
'listing': 'auction',
'location': 'fr, besançon',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 70221,
'odometer_in_km': 70221,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70779,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-21',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech like',
'transmission': 'manual',
'trim': 'like',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 68,
'expiration_date': '2025-12-06T16:51:19Z',
'fuel_type': 'petrol',
'id': '0ed20c51-7272-5fb1-a337-87a1371c0228',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL41692',
'listing': 'auction',
'location': 'FR, Besançon',
'make': 'Peugeot',
'model': '208',
'odometer': 70221,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_aab15054423deff046d4d45990ea1814.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7dd360e4d5ab3f69b079244692026cca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_7d6b1c4bf581ab5d467d9d6ca01e199b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_e8158fc5f08ebf2a3dd9b8f0024ec013.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_a4df2d9cc11b6a2768fc23202f79ccd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9b7ee64ff0b2622d46070401ced1e2f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_6f992b301014dbeb4bbf2b4b65859331.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_f3e9b476fd91ab07511fe60d9848de51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_ade7ab64629cd3f7dd7cfe41fd4a1d5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_1ecda753eb267fae2b61c8d2662a681f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_0c1305cf379fd372c9266c0b41b5c0c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4a454e437c57683b37f621f07ac823ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_9662b570d2918aa2a455d0289233ce32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_bfe79c222f4079545903cc65e7a48554.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_127d886e1cba31f5dcd03cba55df42d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed20c51-7272-5fb1-a337-87a1371c0228/0ed20c51-7272-5fb1-a337-87a1371c0228_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70779,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img69/93/69939523cd17e053ede5f1e50a2009b7/pa/XL41692_4e4cef313b61afe5b0d81ee991f8b74b.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2019}
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL41692%27 HTTP/1.1" 200 None
2025-12-05 17:03:31 [auto1.fr] INFO: Saving data for XL41692: {'created_time': 1764954211.763508, 'last_price_update_time': 1764954211.763519, 'auction_closing_time': 1765039879.0}
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL41692') HTTP/1.1" 204 0
2025-12-05 17:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03eae1ac-df8c-59c6-a6eb-ded3f93334c9 with identifier: UZ57263
2025-12-05 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03eae1ac-df8c-59c6-a6eb-ded3f93334c9 with identifier: UZ57263
2025-12-05 17:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03eae1ac-df8c-59c6-a6eb-ded3f93334c9 with identifier: UZ57263 to the API
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ57263>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:57:37Z',
'fuel_type': 'diesel',
'id': '03eae1ac-df8c-59c6-a6eb-ded3f93334c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ57263',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 121777,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Basis 2WD',
'transmission': 'automatic',
'trim': 'Basis 2WD',
'year': 2018}
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ57263%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [auto1.fr] INFO: Saving data for UZ57263: {'auction_closing_time': 1765040257.0, 'created_time': 1764177317.950542, 'last_price_update_time': 1764954212.103875}
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ57263') HTTP/1.1" 204 0
2025-12-05 17:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70f9061e-89af-5c71-aa85-ea154b3f56c9 with identifier: HC03144
2025-12-05 17:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70f9061e-89af-5c71-aa85-ea154b3f56c9 with identifier: HC03144
2025-12-05 17:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.6 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 85890, 'odometer_reading_unit': 'km', 'registration_date': '2019-10-09', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hc03144', 'expiration_date': '2025-12-06t16:32:01z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '70f9061e-89af-5c71-aa85-ea154b3f56c9', 'current_year_diff': 6, 'age_in_months': 73, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 85890}
Failed validating None in schema:
False
On instance:
{'age_in_months': 73,
'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'engine_horse_power': 181,
'expiration_date': '2025-12-06t16:32:01z',
'fuel_type': 'petrol',
'id': '70f9061e-89af-5c71-aa85-ea154b3f56c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hc03144',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'citroen',
'make_model': 'citroen c5 aircross',
'model': 'c5 aircross',
'odometer': 85890,
'odometer_in_km': 85890,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-09',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c5 aircross 1.6 puretech feel',
'transmission': 'automatic',
'trim': 'feel',
'year': 2019}
2025-12-05 17:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 70f9061e-89af-5c71-aa85-ea154b3f56c9 spider: auto1.fr
2025-12-05 17:03:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 70f9061e-89af-5c71-aa85-ea154b3f56c9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.6 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 85890, 'odometer_reading_unit': 'km', 'registration_date': '2019-10-09', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hc03144', 'expiration_date': '2025-12-06t16:32:01z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '70f9061e-89af-5c71-aa85-ea154b3f56c9', 'current_year_diff': 6, 'age_in_months': 73, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 85890}
Failed validating None in schema:
False
On instance:
{'age_in_months': 73,
'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'engine_horse_power': 181,
'expiration_date': '2025-12-06t16:32:01z',
'fuel_type': 'petrol',
'id': '70f9061e-89af-5c71-aa85-ea154b3f56c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hc03144',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'citroen',
'make_model': 'citroen c5 aircross',
'model': 'c5 aircross',
'odometer': 85890,
'odometer_in_km': 85890,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-09',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c5 aircross 1.6 puretech feel',
'transmission': 'automatic',
'trim': 'feel',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 181,
'expiration_date': '2025-12-06T16:32:01Z',
'fuel_type': 'petrol',
'id': '70f9061e-89af-5c71-aa85-ea154b3f56c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC03144',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 85890,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.6 PureTech Feel',
'transmission': 'automatic',
'trim': 'Feel',
'year': 2019}
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC03144%27 HTTP/1.1" 200 None
2025-12-05 17:03:32 [auto1.fr] INFO: Saving data for HC03144: {'auction_closing_time': 1765038721.0, 'created_time': 1764842584.009981, 'last_price_update_time': 1764954212.334527}
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC03144') HTTP/1.1" 204 0
2025-12-05 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_55f426219ff76010095f0fb847927b44.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_a9cd25e1a657c0a4df4e12bbc4fc25fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN56812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA00385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57cd990>
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_36fd5607bdaff39b5c45c8e3a3ad1a48.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_36fd5607bdaff39b5c45c8e3a3ad1a48.jpg saved to cache
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c52110>
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_46cf5868d0d6712a61f854c7a085e1d6.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_46cf5868d0d6712a61f854c7a085e1d6.jpg saved to cache
2025-12-05 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a5fd0>
2025-12-05 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_9345fbc7097cce9e621858d6b6ac66d9.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_9345fbc7097cce9e621858d6b6ac66d9.jpg saved to cache
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1cf10>
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F09%252F9d096edc875e534ac57487f2e114d215%252Fpa%252FMV78340_55f426219ff76010095f0fb847927b44.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_55f426219ff76010095f0fb847927b44.jpg saved to cache
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a01bbe88-640d-5aff-ac30-821a7165c16d
2025-12-05 17:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a01bbe88-640d-5aff-ac30-821a7165c16d, skipping ID generation
2025-12-05 17:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a01bbe88-640d-5aff-ac30-821a7165c16d with scrape type 1
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a01bbe88-640d-5aff-ac30-821a7165c16d from tracking dictionaries
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a01bbe88-640d-5aff-ac30-821a7165c16d sending to next pipeline
2025-12-05 17:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a01bbe88-640d-5aff-ac30-821a7165c16d, identifier: MV78340
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ded690>
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_a9cd25e1a657c0a4df4e12bbc4fc25fe.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_a9cd25e1a657c0a4df4e12bbc4fc25fe.jpg saved to cache
2025-12-05 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a01bbe88-640d-5aff-ac30-821a7165c16d with identifier: MV78340
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:03:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2025-12-05 17:03:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a01bbe88-640d-5aff-ac30-821a7165c16d with identifier: MV78340
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2025-12-05 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a01bbe88-640d-5aff-ac30-821a7165c16d spider: auto1.fr
2025-12-05 17:03:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a01bbe88-640d-5aff-ac30-821a7165c16d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'color': 'other',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:43:08Z',
'fuel_type': 'diesel',
'id': 'a01bbe88-640d-5aff-ac30-821a7165c16d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV78340',
'listing': 'auction',
'location': 'FR, Castelnau le Lez',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 67722,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_55f426219ff76010095f0fb847927b44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_46cf5868d0d6712a61f854c7a085e1d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e12692da1799384bf54c2483acf37083.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_53cac0ceafd9be25c05283b86ad32098.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_86f073539b44b6cee2914de40fdc2699.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_0c88bbfd5de352c68c3efde4fba77612.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_7d0e3e4ca3c3e710fa1b891c1898247c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_e694b156224abf6e2fc5448287403f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_9968920655eeee59192a00c66f602bab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_acb96ffb07c59bb7e8b69e1f181597e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_15e9e84eb9299583eed685921d17a271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_11ff0e966ead3495dbad7e87f72216e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_01e7518ebedd17e164c1cf2284263a7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_553d8f896bbad0b5a5c7f616e7b17791.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_3f5cc94cdec11a6d1fdbaaa7c82b06f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a01bbe88-640d-5aff-ac30-821a7165c16d/a01bbe88-640d-5aff-ac30-821a7165c16d_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 66981,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img9d/09/9d096edc875e534ac57487f2e114d215/pa/MV78340_84c471438a293483cdcdaaca759ade39.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-26',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 300 L1 Limited',
'transmission': 'manual',
'trim': '300 L1 Limited',
'year': 2022}
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV78340%27 HTTP/1.1" 200 None
2025-12-05 17:03:34 [auto1.fr] INFO: Saving data for MV78340: {'created_time': 1764954214.264096, 'last_price_update_time': 1764954214.264105, 'auction_closing_time': 1765039388.0}
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV78340') HTTP/1.1" 204 0
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC27848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_17ce6c96d10f4f7a7ddf00f8353fa250.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_093669b1e808ec1af12fc8dfdbfc92d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c47cd0>
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_17ce6c96d10f4f7a7ddf00f8353fa250.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_17ce6c96d10f4f7a7ddf00f8353fa250.jpg saved to cache
2025-12-05 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB67796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW95758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57c0fd0>
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_093669b1e808ec1af12fc8dfdbfc92d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_093669b1e808ec1af12fc8dfdbfc92d3.jpg saved to cache
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5842ed0>
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F19%252Fb6194be5e7a3a0bcbdbc40b97b9c4507%252Fpa%252FJB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg saved to cache
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5506abe0-977f-5628-a004-b8369fc2b3ed
2025-12-05 17:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5506abe0-977f-5628-a004-b8369fc2b3ed, skipping ID generation
2025-12-05 17:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5506abe0-977f-5628-a004-b8369fc2b3ed with scrape type 1
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5506abe0-977f-5628-a004-b8369fc2b3ed from tracking dictionaries
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5506abe0-977f-5628-a004-b8369fc2b3ed sending to next pipeline
2025-12-05 17:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5506abe0-977f-5628-a004-b8369fc2b3ed, identifier: JB34017
2025-12-05 17:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4caf050>
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F02%252F8502772249c6d5f27f4da3abf0b22b0b%252Fpa%252FMN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg saved to cache
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197
2025-12-05 17:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a7b1cf9-78a8-50b9-b1e1-1ded84616197, skipping ID generation
2025-12-05 17:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 with scrape type 1
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 from tracking dictionaries
2025-12-05 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 sending to next pipeline
2025-12-05 17:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a7b1cf9-78a8-50b9-b1e1-1ded84616197, identifier: MN69075
2025-12-05 17:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5506abe0-977f-5628-a004-b8369fc2b3ed with identifier: JB34017
2025-12-05 17:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5506abe0-977f-5628-a004-b8369fc2b3ed with identifier: JB34017
2025-12-05 17:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5506abe0-977f-5628-a004-b8369fc2b3ed with identifier: JB34017 to the API
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:11:28Z',
'fuel_type': 'diesel',
'id': '5506abe0-977f-5628-a004-b8369fc2b3ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB34017',
'listing': 'auction',
'location': 'FR, Saint-Léonard',
'make': 'Peugeot',
'model': '308',
'odometer': 63422,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_0f6fa10d1616e80511a0cb3cfa963174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2b6a658742da77b234890820f8804f09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3a774730a63e642b39e20e2fc1115337.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ffaa0696332a63572e337af077fa9702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_cb7fd505ce8ae427b3b761ae32588443.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3209797,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_9345fbc7097cce9e621858d6b6ac66d9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_950d6cd552aae858a88a6e94d708d97d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3233646,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_ebd3b3068d56dc2ecfa0c1586a652eb2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_2ad90fdec903a9115a87c43ea3fba900.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_5b594c27ae23758bcb0721a966cfa485.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_3520db0778a7702941580b610d2728fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2978201,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_17ce6c96d10f4f7a7ddf00f8353fa250.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_bb5880ca54a7a6b35ff440bd6362001a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2952649,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_093669b1e808ec1af12fc8dfdbfc92d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_78772bbfcda9924f8b1e92389de1edcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5506abe0-977f-5628-a004-b8369fc2b3ed/5506abe0-977f-5628-a004-b8369fc2b3ed_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71278,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/19/b6194be5e7a3a0bcbdbc40b97b9c4507/pa/JB34017_d2b7be0e3b8fb50ca80c32d5b3a89ef9.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-25',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Active Pack',
'transmission': 'manual',
'trim': 'Active Pack',
'year': 2021}
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB34017%27 HTTP/1.1" 200 None
2025-12-05 17:03:36 [auto1.fr] INFO: Saving data for JB34017: {'created_time': 1764954216.292115, 'last_price_update_time': 1764954216.292125, 'auction_closing_time': 1765037488.0}
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB34017') HTTP/1.1" 204 0
2025-12-05 17:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 with identifier: MN69075
2025-12-05 17:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 with identifier: MN69075
2025-12-05 17:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a7b1cf9-78a8-50b9-b1e1-1ded84616197 with identifier: MN69075 to the API
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:14:55Z',
'fuel_type': 'diesel',
'id': '1a7b1cf9-78a8-50b9-b1e1-1ded84616197',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN69075',
'listing': 'auction',
'location': 'FR, Wambrechies',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 65485,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_a9cd25e1a657c0a4df4e12bbc4fc25fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2786860,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_21e7821fb9d53dcb2bd4aa3800c20c9f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_36fd5607bdaff39b5c45c8e3a3ad1a48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f00bd4b23cc6c1f11dca76ff3af9fce0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f0845d5831c6010a7ca201568bf3928b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2631858,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_bbd11c80e76b0545499717f940ef769d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640505,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_dcb65ffcab95d86fece6d4636b9e783b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575050,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_718a24e2789d75184d1fcf6659a3adb5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_f1a2e9c4e0040c99ac8e98383f62f2f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2793145,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_eb02196182de6d7fb9f2883a23893153.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2800515,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_4b6465312ba104612974b11cc1d09c15.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2790596,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_292eb9acb1af6d3d682dcc4cff85fbff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_30eca362a36a2ebed4af7e9217d60729.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2651040,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c8e3ed6cafa8f20e62789fb20f5714ba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_c08eb78c951ec2609836f9c953962f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a7b1cf9-78a8-50b9-b1e1-1ded84616197/1a7b1cf9-78a8-50b9-b1e1-1ded84616197_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/02/8502772249c6d5f27f4da3abf0b22b0b/pa/MN69075_d057bfd55c65a868a3359cb074fb97df.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Diesel SE',
'transmission': 'automatic',
'trim': 'SE',
'year': 2018}
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN69075%27 HTTP/1.1" 200 None
2025-12-05 17:03:36 [auto1.fr] INFO: Saving data for MN69075: {'created_time': 1764954216.673264, 'last_price_update_time': 1764954216.673276, 'auction_closing_time': 1765037695.0}
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN69075') HTTP/1.1" 204 0
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY80790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ91961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW47310> (referer: https://www.auto1.com/v1/car-details-view/RW47310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX25877> (referer: https://www.auto1.com/v1/car-details-view/FX25877/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:36 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6886569c-c1b2-5ca0-837c-344473098f5d with identifier: RW47310
2025-12-05 17:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6886569c-c1b2-5ca0-837c-344473098f5d with scrape type 2
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6886569c-c1b2-5ca0-837c-344473098f5d with scrape type 2
2025-12-05 17:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6886569c-c1b2-5ca0-837c-344473098f5d, identifier: RW47310
2025-12-05 17:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc9dce48-2347-572d-8745-9245f1529621 with identifier: FX25877
2025-12-05 17:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc9dce48-2347-572d-8745-9245f1529621 with scrape type 2
2025-12-05 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc9dce48-2347-572d-8745-9245f1529621 with scrape type 2
2025-12-05 17:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc9dce48-2347-572d-8745-9245f1529621, identifier: FX25877
2025-12-05 17:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6886569c-c1b2-5ca0-837c-344473098f5d with identifier: RW47310
2025-12-05 17:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6886569c-c1b2-5ca0-837c-344473098f5d with identifier: RW47310
2025-12-05 17:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 85515, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rw47310', 'expiration_date': '2025-12-06t16:04:00z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '6886569c-c1b2-5ca0-837c-344473098f5d', 'current_year_diff': 6, 'age_in_months': 78, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 85515}
Failed validating None in schema:
False
On instance:
{'age_in_months': 78,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:04:00z',
'fuel_type': 'petrol',
'id': '6886569c-c1b2-5ca0-837c-344473098f5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rw47310',
'listing': 'auction',
'location': 'fr, beaucaire',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 85515,
'odometer_in_km': 85515,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 e-thp allure business',
'transmission': 'automatic',
'trim': 'allure business',
'year': 2019}
2025-12-05 17:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 6886569c-c1b2-5ca0-837c-344473098f5d spider: auto1.fr
2025-12-05 17:03:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6886569c-c1b2-5ca0-837c-344473098f5d due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 85515, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rw47310', 'expiration_date': '2025-12-06t16:04:00z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '6886569c-c1b2-5ca0-837c-344473098f5d', 'current_year_diff': 6, 'age_in_months': 78, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 85515}
Failed validating None in schema:
False
On instance:
{'age_in_months': 78,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:04:00z',
'fuel_type': 'petrol',
'id': '6886569c-c1b2-5ca0-837c-344473098f5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rw47310',
'listing': 'auction',
'location': 'fr, beaucaire',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 85515,
'odometer_in_km': 85515,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 e-thp allure business',
'transmission': 'automatic',
'trim': 'allure business',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:04:00Z',
'fuel_type': 'petrol',
'id': '6886569c-c1b2-5ca0-837c-344473098f5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW47310',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '2008',
'odometer': 85515,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-THP Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW47310%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Saving data for RW47310: {'auction_closing_time': 1765037040.0, 'created_time': 1764842554.205932, 'last_price_update_time': 1764954217.217906}
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RW47310') HTTP/1.1" 204 0
2025-12-05 17:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc9dce48-2347-572d-8745-9245f1529621 with identifier: FX25877
2025-12-05 17:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc9dce48-2347-572d-8745-9245f1529621 with identifier: FX25877
2025-12-05 17:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cc9dce48-2347-572d-8745-9245f1529621 with identifier: FX25877 to the API
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FX25877>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 67,
'expiration_date': '2025-12-06T16:40:02Z',
'fuel_type': 'petrol',
'id': 'cc9dce48-2347-572d-8745-9245f1529621',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX25877',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Renault',
'model': 'Clio',
'odometer': 48056,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 SCe Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2021}
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX25877%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Saving data for FX25877: {'auction_closing_time': 1765039202.0, 'created_time': 1764867702.527796, 'last_price_update_time': 1764954217.521707}
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX25877') HTTP/1.1" 204 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: DH81844
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH81844%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for DH81844: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: BH01021
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH01021%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for BH01021: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: HK74147
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK74147%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for HK74147: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: JT70384
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT70384%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for JT70384: 2
2025-12-05 17:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY46442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: BC15744
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC15744%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for BC15744: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: LV13271
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV13271%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for LV13271: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: AB97785
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB97785%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for AB97785: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: SF20432
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF20432%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for SF20432: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: VG71674
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG71674%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for VG71674: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: CT20802
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT20802%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for CT20802: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: VH08870
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH08870%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for VH08870: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: BN96848
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN96848%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for BN96848: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: UG41490
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG41490%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for UG41490: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: RH76441
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH76441%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for RH76441: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: DM95662
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM95662%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for DM95662: 0
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: GX46284
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX46284%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for GX46284: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: ET93870
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET93870%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for ET93870: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: AP30057
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP30057%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for AP30057: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: RF17814
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF17814%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for RF17814: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: VD63915
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD63915%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for VD63915: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: FT88600
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT88600%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for FT88600: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: LK94361
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK94361%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for LK94361: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: KX17543
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX17543%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for KX17543: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: PZ60998
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ60998%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for PZ60998: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: BJ04401
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ04401%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for BJ04401: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: DY74317
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY74317%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for DY74317: 2
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: DA60540
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA60540%27 HTTP/1.1" 200 None
2025-12-05 17:03:37 [auto1.fr] INFO: Scrape type for DA60540: 1
2025-12-05 17:03:37 [auto1.fr] INFO: Found listing with ID: VB77810
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB77810%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for VB77810: 1
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: FP33606
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP33606%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for FP33606: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: PL28314
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL28314%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for PL28314: 1
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: TK87277
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK87277%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for TK87277: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: PT08922
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT08922%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for PT08922: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: KC14104
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC14104%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for KC14104: 1
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: GZ55332
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ55332%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for GZ55332: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: RF86513
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF86513%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for RF86513: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: TH90678
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH90678%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for TH90678: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: YL29400
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL29400%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for YL29400: 1
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: HF68433
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF68433%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for HF68433: 1
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: ZW79430
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW79430%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for ZW79430: 2
2025-12-05 17:03:38 [auto1.fr] INFO: Found listing with ID: BS73925
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS73925%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Scrape type for BS73925: 2
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD20324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL22558> (referer: https://www.auto1.com/v1/car-details-view/UL22558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY67356> (referer: https://www.auto1.com/v1/car-details-view/WY67356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC27848> (referer: https://www.auto1.com/v1/car-details-view/BC27848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088aaf0f-4252-5002-a4a9-55066db9cf78 with identifier: UL22558
2025-12-05 17:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088aaf0f-4252-5002-a4a9-55066db9cf78 with scrape type 2
2025-12-05 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088aaf0f-4252-5002-a4a9-55066db9cf78 with scrape type 2
2025-12-05 17:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 088aaf0f-4252-5002-a4a9-55066db9cf78, identifier: UL22558
2025-12-05 17:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 088aaf0f-4252-5002-a4a9-55066db9cf78 with identifier: UL22558
2025-12-05 17:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 088aaf0f-4252-5002-a4a9-55066db9cf78 with identifier: UL22558
2025-12-05 17:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 088aaf0f-4252-5002-a4a9-55066db9cf78 with identifier: UL22558 to the API
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL22558>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 163,
'expiration_date': '2025-12-06T16:25:59Z',
'fuel_type': 'petrol',
'id': '088aaf0f-4252-5002-a4a9-55066db9cf78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL22558',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 32256,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL22558%27 HTTP/1.1" 200 None
2025-12-05 17:03:38 [auto1.fr] INFO: Saving data for UL22558: {'auction_closing_time': 1765038359.0, 'created_time': 1764756143.36475, 'last_price_update_time': 1764954218.96892}
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL22558') HTTP/1.1" 204 0
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB61551> (referer: https://www.auto1.com/v1/car-details-view/WB61551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN56812> (referer: https://www.auto1.com/v1/car-details-view/SN56812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE28497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA00385> (referer: https://www.auto1.com/v1/car-details-view/ZA00385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc7af43-5c7d-5925-8bb7-da86207e4e7a with identifier: WY67356
2025-12-05 17:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc7af43-5c7d-5925-8bb7-da86207e4e7a with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc7af43-5c7d-5925-8bb7-da86207e4e7a with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ffc7af43-5c7d-5925-8bb7-da86207e4e7a, identifier: WY67356
2025-12-05 17:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab4fa422-1654-57c0-8d58-becf27cc0194 with identifier: BC27848
2025-12-05 17:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab4fa422-1654-57c0-8d58-becf27cc0194 with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab4fa422-1654-57c0-8d58-becf27cc0194 with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab4fa422-1654-57c0-8d58-becf27cc0194, identifier: BC27848
2025-12-05 17:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ffc7af43-5c7d-5925-8bb7-da86207e4e7a with identifier: WY67356
2025-12-05 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ffc7af43-5c7d-5925-8bb7-da86207e4e7a with identifier: WY67356
2025-12-05 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 53047, 'odometer_reading_unit': 'km', 'registration_date': '2022-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wy67356', 'expiration_date': '2025-12-06t16:59:21z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'ffc7af43-5c7d-5925-8bb7-da86207e4e7a', 'current_year_diff': 3, 'age_in_months': 39, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 53047}
Failed validating None in schema:
False
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:59:21z',
'fuel_type': 'petrol',
'id': 'ffc7af43-5c7d-5925-8bb7-da86207e4e7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wy67356',
'listing': 'auction',
'location': 'fr, saint-saulve',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 53047,
'odometer_in_km': 53047,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-30',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine pack',
'transmission': 'manual',
'trim': 'shine pack',
'year': 2022}
2025-12-05 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ffc7af43-5c7d-5925-8bb7-da86207e4e7a spider: auto1.fr
2025-12-05 17:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ffc7af43-5c7d-5925-8bb7-da86207e4e7a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 53047, 'odometer_reading_unit': 'km', 'registration_date': '2022-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wy67356', 'expiration_date': '2025-12-06t16:59:21z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'ffc7af43-5c7d-5925-8bb7-da86207e4e7a', 'current_year_diff': 3, 'age_in_months': 39, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 53047}
Failed validating None in schema:
False
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:59:21z',
'fuel_type': 'petrol',
'id': 'ffc7af43-5c7d-5925-8bb7-da86207e4e7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wy67356',
'listing': 'auction',
'location': 'fr, saint-saulve',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 53047,
'odometer_in_km': 53047,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-30',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine pack',
'transmission': 'manual',
'trim': 'shine pack',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:59:21Z',
'fuel_type': 'petrol',
'id': 'ffc7af43-5c7d-5925-8bb7-da86207e4e7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY67356',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Citroen',
'model': 'C3',
'odometer': 53047,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine Pack',
'transmission': 'manual',
'trim': 'Shine Pack',
'year': 2022}
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY67356%27 HTTP/1.1" 200 None
2025-12-05 17:03:39 [auto1.fr] INFO: Saving data for WY67356: {'auction_closing_time': 1765040361.0, 'created_time': 1764842727.810272, 'last_price_update_time': 1764954219.537638}
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WY67356') HTTP/1.1" 204 0
2025-12-05 17:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab4fa422-1654-57c0-8d58-becf27cc0194 with identifier: BC27848
2025-12-05 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab4fa422-1654-57c0-8d58-becf27cc0194 with identifier: BC27848
2025-12-05 17:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab4fa422-1654-57c0-8d58-becf27cc0194 with identifier: BC27848 to the API
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC27848>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 230,
'expiration_date': '2025-12-06T16:21:55Z',
'fuel_type': 'petrol',
'id': 'ab4fa422-1654-57c0-8d58-becf27cc0194',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC27848',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Audi',
'model': 'TT',
'odometer': 138886,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-06',
'seats_number': 4,
'seller_name': None,
'title': 'Audi TT 2.0 TFSI Coupe',
'transmission': 'automatic',
'trim': 'Coupe',
'year': 2017}
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC27848%27 HTTP/1.1" 200 None
2025-12-05 17:03:39 [auto1.fr] INFO: Saving data for BC27848: {'auction_closing_time': 1765038115.0, 'created_time': 1764756190.743848, 'last_price_update_time': 1764954219.854946}
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC27848') HTTP/1.1" 204 0
2025-12-05 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW95758> (referer: https://www.auto1.com/v1/car-details-view/GW95758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8 with identifier: WB61551
2025-12-05 17:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8 with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8 with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8, identifier: WB61551
2025-12-05 17:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3418a323-f181-5280-b5e7-375a53ba2bef with identifier: SN56812
2025-12-05 17:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3418a323-f181-5280-b5e7-375a53ba2bef with scrape type 2
2025-12-05 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3418a323-f181-5280-b5e7-375a53ba2bef with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3418a323-f181-5280-b5e7-375a53ba2bef, identifier: SN56812
2025-12-05 17:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b43b64ee-7010-5898-9774-a691838e09f7 with identifier: ZA00385
2025-12-05 17:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43b64ee-7010-5898-9774-a691838e09f7 with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b43b64ee-7010-5898-9774-a691838e09f7 with scrape type 2
2025-12-05 17:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b43b64ee-7010-5898-9774-a691838e09f7, identifier: ZA00385
2025-12-05 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8 with identifier: WB61551
2025-12-05 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8 with identifier: WB61551
2025-12-05 17:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8 with identifier: WB61551 to the API
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB61551>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2025-12-06T16:08:22Z',
'fuel_type': 'hybrid',
'id': '7f2767fe-7fc5-5d8c-a3ce-6f9fbd269cf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB61551',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 90369,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 1.6 Hybrid Creative 2WD',
'transmission': 'automatic',
'trim': 'Creative 2WD',
'year': 2020}
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB61551%27 HTTP/1.1" 200 None
2025-12-05 17:03:40 [auto1.fr] INFO: Saving data for WB61551: {'auction_closing_time': 1765037302.0, 'created_time': 1762449041.559571, 'last_price_update_time': 1764954220.486545}
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB61551') HTTP/1.1" 204 0
2025-12-05 17:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3418a323-f181-5280-b5e7-375a53ba2bef with identifier: SN56812
2025-12-05 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3418a323-f181-5280-b5e7-375a53ba2bef with identifier: SN56812
2025-12-05 17:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3418a323-f181-5280-b5e7-375a53ba2bef with identifier: SN56812 to the API
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN56812>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:51:03Z',
'fuel_type': 'diesel',
'id': '3418a323-f181-5280-b5e7-375a53ba2bef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN56812',
'listing': 'auction',
'location': 'FR, Ambérieu en Bugey',
'make': 'Peugeot',
'model': '3008',
'odometer': 92190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2018}
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN56812%27 HTTP/1.1" 200 None
2025-12-05 17:03:40 [auto1.fr] INFO: Saving data for SN56812: {'auction_closing_time': 1765039863.0, 'created_time': 1764842567.895904, 'last_price_update_time': 1764954220.873237}
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SN56812') HTTP/1.1" 204 0
2025-12-05 17:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b43b64ee-7010-5898-9774-a691838e09f7 with identifier: ZA00385
2025-12-05 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b43b64ee-7010-5898-9774-a691838e09f7 with identifier: ZA00385
2025-12-05 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160648 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
160648
2025-12-05 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b43b64ee-7010-5898-9774-a691838e09f7 spider: auto1.fr
2025-12-05 17:03:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b43b64ee-7010-5898-9774-a691838e09f7 due to rule: high_mileage_for_country.json, error: 160648 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
160648
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2025-12-06T16:45:34Z',
'fuel_type': 'diesel',
'id': 'b43b64ee-7010-5898-9774-a691838e09f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA00385',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 160648,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi La Premiere',
'transmission': 'automatic',
'trim': 'La Premiere',
'year': 2018}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA00385%27 HTTP/1.1" 200 None
2025-12-05 17:03:41 [auto1.fr] INFO: Saving data for ZA00385: {'auction_closing_time': 1765039534.0, 'created_time': 1764756404.655029, 'last_price_update_time': 1764954221.082557}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZA00385') HTTP/1.1" 204 0
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ91961> (referer: https://www.auto1.com/v1/car-details-view/CJ91961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB67796> (referer: https://www.auto1.com/v1/car-details-view/LB67796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY80790> (referer: https://www.auto1.com/v1/car-details-view/CY80790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23 with identifier: GW95758
2025-12-05 17:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23 with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23 with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23, identifier: GW95758
2025-12-05 17:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23 with identifier: GW95758
2025-12-05 17:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23 with identifier: GW95758
2025-12-05 17:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4c0c1ed5-bc46-53e2-8a7d-a802b0842d23 with identifier: GW95758 to the API
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW95758>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': 'Taxi',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2025-12-06T16:24:07Z',
'fuel_type': 'hybrid',
'id': '4c0c1ed5-bc46-53e2-8a7d-a802b0842d23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW95758',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Renault',
'model': 'Arkana',
'odometer': 84340,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.6 Hybrid E-Tech Engineered',
'transmission': 'automatic',
'trim': 'Engineered',
'year': 2023}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW95758%27 HTTP/1.1" 200 None
2025-12-05 17:03:41 [auto1.fr] INFO: Saving data for GW95758: {'auction_closing_time': 1765038247.0, 'created_time': 1764781319.359399, 'last_price_update_time': 1764954221.542321}
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GW95758') HTTP/1.1" 204 0
2025-12-05 17:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e73232ef-8247-58c5-9c14-4adc3e01c10d with identifier: CJ91961
2025-12-05 17:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e73232ef-8247-58c5-9c14-4adc3e01c10d with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e73232ef-8247-58c5-9c14-4adc3e01c10d with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e73232ef-8247-58c5-9c14-4adc3e01c10d, identifier: CJ91961
2025-12-05 17:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7693130f-80b7-5f05-9d59-0c6d8f3afb24 with identifier: LB67796
2025-12-05 17:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7693130f-80b7-5f05-9d59-0c6d8f3afb24 with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7693130f-80b7-5f05-9d59-0c6d8f3afb24 with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7693130f-80b7-5f05-9d59-0c6d8f3afb24, identifier: LB67796
2025-12-05 17:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d31b68c0-5200-5723-b521-20cd9b894f30 with identifier: CY80790
2025-12-05 17:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d31b68c0-5200-5723-b521-20cd9b894f30 with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d31b68c0-5200-5723-b521-20cd9b894f30 with scrape type 2
2025-12-05 17:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d31b68c0-5200-5723-b521-20cd9b894f30, identifier: CY80790
2025-12-05 17:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e73232ef-8247-58c5-9c14-4adc3e01c10d with identifier: CJ91961
2025-12-05 17:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e73232ef-8247-58c5-9c14-4adc3e01c10d with identifier: CJ91961
2025-12-05 17:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 61648, 'odometer_reading_unit': 'km', 'registration_date': '2021-01-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cj91961', 'expiration_date': '2025-12-06t16:54:46z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fontaine-le-comte', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 122, 'id': 'e73232ef-8247-58c5-9c14-4adc3e01c10d', 'current_year_diff': 4, 'age_in_months': 58, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 61648}
Failed validating None in schema:
False
On instance:
{'age_in_months': 58,
'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'orange',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:54:46z',
'fuel_type': 'petrol',
'id': 'e73232ef-8247-58c5-9c14-4adc3e01c10d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cj91961',
'listing': 'auction',
'location': 'fontaine-le-comte',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 61648,
'odometer_in_km': 61648,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech active business',
'transmission': 'manual',
'trim': 'active business',
'year': 2021}
2025-12-05 17:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e73232ef-8247-58c5-9c14-4adc3e01c10d spider: auto1.fr
2025-12-05 17:03:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e73232ef-8247-58c5-9c14-4adc3e01c10d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 61648, 'odometer_reading_unit': 'km', 'registration_date': '2021-01-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cj91961', 'expiration_date': '2025-12-06t16:54:46z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fontaine-le-comte', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 122, 'id': 'e73232ef-8247-58c5-9c14-4adc3e01c10d', 'current_year_diff': 4, 'age_in_months': 58, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 61648}
Failed validating None in schema:
False
On instance:
{'age_in_months': 58,
'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'orange',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:54:46z',
'fuel_type': 'petrol',
'id': 'e73232ef-8247-58c5-9c14-4adc3e01c10d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cj91961',
'listing': 'auction',
'location': 'fontaine-le-comte',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 61648,
'odometer_in_km': 61648,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech active business',
'transmission': 'manual',
'trim': 'active business',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:54:46Z',
'fuel_type': 'petrol',
'id': 'e73232ef-8247-58c5-9c14-4adc3e01c10d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ91961',
'listing': 'auction',
'location': 'Fontaine-le-Comte',
'make': 'Peugeot',
'model': '2008',
'odometer': 61648,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2021}
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ91961%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Saving data for CJ91961: {'auction_closing_time': 1765040086.0, 'created_time': 1764842616.606308, 'last_price_update_time': 1764954222.047362}
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ91961') HTTP/1.1" 204 0
2025-12-05 17:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7693130f-80b7-5f05-9d59-0c6d8f3afb24 with identifier: LB67796
2025-12-05 17:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7693130f-80b7-5f05-9d59-0c6d8f3afb24 with identifier: LB67796
2025-12-05 17:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 131618, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb67796', 'expiration_date': '2025-12-06t16:22:04z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'aix-en-provence', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 97, 'id': '7693130f-80b7-5f05-9d59-0c6d8f3afb24', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 131618}
Failed validating None in schema:
False
On instance:
{'age_in_months': 104,
'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:22:04z',
'fuel_type': 'petrol',
'id': '7693130f-80b7-5f05-9d59-0c6d8f3afb24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb67796',
'listing': 'auction',
'location': 'aix-en-provence',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 131618,
'odometer_in_km': 131618,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-23',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2017}
2025-12-05 17:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 7693130f-80b7-5f05-9d59-0c6d8f3afb24 spider: auto1.fr
2025-12-05 17:03:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7693130f-80b7-5f05-9d59-0c6d8f3afb24 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 131618, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb67796', 'expiration_date': '2025-12-06t16:22:04z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'aix-en-provence', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 97, 'id': '7693130f-80b7-5f05-9d59-0c6d8f3afb24', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 131618}
Failed validating None in schema:
False
On instance:
{'age_in_months': 104,
'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:22:04z',
'fuel_type': 'petrol',
'id': '7693130f-80b7-5f05-9d59-0c6d8f3afb24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb67796',
'listing': 'auction',
'location': 'aix-en-provence',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 131618,
'odometer_in_km': 131618,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-23',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:22:04Z',
'fuel_type': 'petrol',
'id': '7693130f-80b7-5f05-9d59-0c6d8f3afb24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB67796',
'listing': 'auction',
'location': 'Aix-en-Provence',
'make': 'Peugeot',
'model': '308',
'odometer': 131618,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2017}
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB67796%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Saving data for LB67796: {'auction_closing_time': 1765038124.0, 'created_time': 1764756108.504782, 'last_price_update_time': 1764954222.282915}
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LB67796') HTTP/1.1" 204 0
2025-12-05 17:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d31b68c0-5200-5723-b521-20cd9b894f30 with identifier: CY80790
2025-12-05 17:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d31b68c0-5200-5723-b521-20cd9b894f30 with identifier: CY80790
2025-12-05 17:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d31b68c0-5200-5723-b521-20cd9b894f30 with identifier: CY80790 to the API
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY80790>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2025-12-06T16:27:30Z',
'fuel_type': 'petrol',
'id': 'd31b68c0-5200-5723-b521-20cd9b894f30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY80790',
'listing': 'auction',
'location': 'FR, Grésy-sur-Aix',
'make': 'Renault',
'model': 'Clio',
'odometer': 6305,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Techno',
'transmission': 'manual',
'trim': 'Techno',
'year': 2024}
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY80790%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Saving data for CY80790: {'auction_closing_time': 1765038450.0, 'created_time': 1764756186.306335, 'last_price_update_time': 1764954222.578893}
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY80790') HTTP/1.1" 204 0
2025-12-05 17:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC15744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT70384/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH01021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:42 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: JP40036
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP40036%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for JP40036: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: DK94283
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK94283%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for DK94283: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: GJ30657
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ30657%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for GJ30657: 1
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: XZ69035
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ69035%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for XZ69035: 1
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: SM03961
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM03961%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for SM03961: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: YD05888
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD05888%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for YD05888: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: WR33594
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR33594%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for WR33594: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: SC31199
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC31199%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for SC31199: 1
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: NF21079
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF21079%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for NF21079: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: ZE60105
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE60105%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for ZE60105: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: DP90188
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP90188%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for DP90188: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: SD43033
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD43033%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for SD43033: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: AD95675
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD95675%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for AD95675: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: JU72339
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU72339%27 HTTP/1.1" 200 None
2025-12-05 17:03:42 [auto1.fr] INFO: Scrape type for JU72339: 2
2025-12-05 17:03:42 [auto1.fr] INFO: Found listing with ID: UX38433
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX38433%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for UX38433: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: YR67880
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR67880%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for YR67880: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: CJ26532
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ26532%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for CJ26532: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: YD02456
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD02456%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for YD02456: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: SA38303
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA38303%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for SA38303: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: FP82552
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP82552%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for FP82552: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: GD07581
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD07581%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for GD07581: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: TK09971
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK09971%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for TK09971: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: FW60092
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW60092%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for FW60092: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: AY74996
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY74996%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for AY74996: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: FD63304
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD63304%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for FD63304: 1
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: NB63635
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB63635%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for NB63635: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: ZP06562
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP06562%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for ZP06562: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: BE20714
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE20714%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for BE20714: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: AT20955
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT20955%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for AT20955: 2
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS73925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: SH41578
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH41578%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for SH41578: 2
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: CW68011
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW68011%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for CW68011: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: HT62389
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT62389%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for HT62389: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: NK69259
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK69259%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for NK69259: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: VC69297
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC69297%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for VC69297: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: DE55145
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE55145%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for DE55145: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: RY66353
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY66353%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for RY66353: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: VC10323
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC10323%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for VC10323: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: WJ66404
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ66404%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for WJ66404: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: YC19124
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC19124%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for YC19124: 2
2025-12-05 17:03:43 [auto1.fr] INFO: Found listing with ID: KN66088
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN66088%27 HTTP/1.1" 200 None
2025-12-05 17:03:43 [auto1.fr] INFO: Scrape type for KN66088: 2
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW79430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL29400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ55332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH90678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF68433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD20324> (referer: https://www.auto1.com/v1/car-details-view/WD20324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF86513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26e2d698-67d0-59ef-9c59-585d5b2ee28b with identifier: WD20324
2025-12-05 17:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26e2d698-67d0-59ef-9c59-585d5b2ee28b with scrape type 2
2025-12-05 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26e2d698-67d0-59ef-9c59-585d5b2ee28b with scrape type 2
2025-12-05 17:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26e2d698-67d0-59ef-9c59-585d5b2ee28b, identifier: WD20324
2025-12-05 17:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26e2d698-67d0-59ef-9c59-585d5b2ee28b with identifier: WD20324
2025-12-05 17:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26e2d698-67d0-59ef-9c59-585d5b2ee28b with identifier: WD20324
2025-12-05 17:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26e2d698-67d0-59ef-9c59-585d5b2ee28b with identifier: WD20324 to the API
2025-12-05 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD20324>
{'auction_title': '',
'c_o_2_emission_value': 48,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2025-12-06T16:59:33Z',
'fuel_type': 'hybrid',
'id': '26e2d698-67d0-59ef-9c59-585d5b2ee28b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD20324',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': 'X3',
'odometer': 92190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD20324%27 HTTP/1.1" 200 None
2025-12-05 17:03:44 [auto1.fr] INFO: Saving data for WD20324: {'auction_closing_time': 1765040373.0, 'created_time': 1763107248.147466, 'last_price_update_time': 1764954224.191573}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD20324') HTTP/1.1" 204 0
2025-12-05 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC14104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE28497> (referer: https://www.auto1.com/v1/car-details-view/AE28497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8af4e40-12e3-5e38-a834-6390bc2f663d with identifier: AE28497
2025-12-05 17:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8af4e40-12e3-5e38-a834-6390bc2f663d with scrape type 2
2025-12-05 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8af4e40-12e3-5e38-a834-6390bc2f663d with scrape type 2
2025-12-05 17:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8af4e40-12e3-5e38-a834-6390bc2f663d, identifier: AE28497
2025-12-05 17:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8af4e40-12e3-5e38-a834-6390bc2f663d with identifier: AE28497
2025-12-05 17:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8af4e40-12e3-5e38-a834-6390bc2f663d with identifier: AE28497
2025-12-05 17:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b8af4e40-12e3-5e38-a834-6390bc2f663d with identifier: AE28497 to the API
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE28497>
{'auction_title': '',
'c_o_2_emission_value': 5,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 179,
'expiration_date': '2025-12-06T16:47:18Z',
'fuel_type': 'electro',
'id': 'b8af4e40-12e3-5e38-a834-6390bc2f663d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE28497',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Skoda',
'model': 'Enyaq',
'odometer': 66988,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Enyaq iV 60 Loft',
'transmission': 'automatic',
'trim': 'Loft',
'year': 2022}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE28497%27 HTTP/1.1" 200 None
2025-12-05 17:03:44 [auto1.fr] INFO: Saving data for AE28497: {'auction_closing_time': 1765039638.0, 'created_time': 1764756183.71422, 'last_price_update_time': 1764954224.812011}
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AE28497') HTTP/1.1" 204 0
2025-12-05 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL28314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK87277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP33606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT20955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB77810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA60540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN66088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT08922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC19124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ66404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW79430> (referer: https://www.auto1.com/v1/car-details-view/ZW79430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a040c8b3-b1c3-5861-bc92-0cb67c18c52d with identifier: ZW79430
2025-12-05 17:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a040c8b3-b1c3-5861-bc92-0cb67c18c52d with scrape type 2
2025-12-05 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a040c8b3-b1c3-5861-bc92-0cb67c18c52d with scrape type 2
2025-12-05 17:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a040c8b3-b1c3-5861-bc92-0cb67c18c52d, identifier: ZW79430
2025-12-05 17:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a040c8b3-b1c3-5861-bc92-0cb67c18c52d with identifier: ZW79430
2025-12-05 17:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a040c8b3-b1c3-5861-bc92-0cb67c18c52d with identifier: ZW79430
2025-12-05 17:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155391 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
155391
2025-12-05 17:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a040c8b3-b1c3-5861-bc92-0cb67c18c52d spider: auto1.fr
2025-12-05 17:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a040c8b3-b1c3-5861-bc92-0cb67c18c52d due to rule: high_mileage_for_country.json, error: 155391 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
155391
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:59:32Z',
'fuel_type': 'diesel',
'id': 'a040c8b3-b1c3-5861-bc92-0cb67c18c52d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW79430',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'BMW',
'model': '4er',
'odometer': 155391,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-08-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 4er 420d Gran Coupé xDrive Luxury Line',
'transmission': 'automatic',
'trim': 'xDrive Luxury Line',
'year': 2016}
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW79430%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [auto1.fr] INFO: Saving data for ZW79430: {'auction_closing_time': 1765040372.0, 'created_time': 1763658534.936391, 'last_price_update_time': 1764954226.278304}
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW79430') HTTP/1.1" 204 0
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC10323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY66353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS73925> (referer: https://www.auto1.com/v1/car-details-view/BS73925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC14104> (referer: https://www.auto1.com/v1/car-details-view/KC14104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdac5c16-1616-5658-a94f-4c560da54bb9 with identifier: BS73925
2025-12-05 17:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdac5c16-1616-5658-a94f-4c560da54bb9 with scrape type 2
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdac5c16-1616-5658-a94f-4c560da54bb9 with scrape type 2
2025-12-05 17:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cdac5c16-1616-5658-a94f-4c560da54bb9, identifier: BS73925
2025-12-05 17:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cdac5c16-1616-5658-a94f-4c560da54bb9 with identifier: BS73925
2025-12-05 17:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cdac5c16-1616-5658-a94f-4c560da54bb9 with identifier: BS73925
2025-12-05 17:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163586 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163586
2025-12-05 17:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cdac5c16-1616-5658-a94f-4c560da54bb9 spider: auto1.fr
2025-12-05 17:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: cdac5c16-1616-5658-a94f-4c560da54bb9 due to rule: high_mileage_for_country.json, error: 163586 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
163586
{'auction_title': '',
'c_o_2_emission_value': 171,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2025-12-06T16:31:20Z',
'fuel_type': 'diesel',
'id': 'cdac5c16-1616-5658-a94f-4c560da54bb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS73925',
'listing': 'auction',
'location': 'FR',
'make': 'Land Rover',
'model': 'Discovery 5',
'odometer': 163586,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-10',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 HSE',
'transmission': 'automatic',
'trim': 'SD4 HSE',
'year': 2017}
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS73925%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [auto1.fr] INFO: Saving data for BS73925: {'auction_closing_time': 1765038680.0, 'created_time': 1764177096.543008, 'last_price_update_time': 1764954226.897272}
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BS73925') HTTP/1.1" 204 0
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF68433> (referer: https://www.auto1.com/v1/car-details-view/HF68433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH90678> (referer: https://www.auto1.com/v1/car-details-view/TH90678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33211055-6702-50e8-998c-d6415542e5a8 with identifier: KC14104
2025-12-05 17:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33211055-6702-50e8-998c-d6415542e5a8 with scrape type 1
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 33211055-6702-50e8-998c-d6415542e5a8
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_ab301a1bc8e1b1786cbc6f3ee753b141.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_ab301a1bc8e1b1786cbc6f3ee753b141.png already downloaded
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_c5d34c51dc51fcc2eaafd1f509b9f32f.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_c5d34c51dc51fcc2eaafd1f509b9f32f.png already downloaded
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_42b2579cd4f1de1721a3fcf9b73063e4.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_42b2579cd4f1de1721a3fcf9b73063e4.png already downloaded
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_1ea0be3bab584c8e20a4967b00c73be7.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_1ea0be3bab584c8e20a4967b00c73be7.png already downloaded
2025-12-05 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_e9276f9d7ef838aa1a031855003931e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_e9276f9d7ef838aa1a031855003931e4.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_0708dd4f5a001df52c50f4a232f83fa3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_0708dd4f5a001df52c50f4a232f83fa3.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_02f5b0f8f0ec3f6df27b22998e16683b.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_02f5b0f8f0ec3f6df27b22998e16683b.png already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_047ec235340b7df98acb062db7b8945e.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_047ec235340b7df98acb062db7b8945e.png already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_ec734df21cc6d75feeb8d143aaf5f56c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_ec734df21cc6d75feeb8d143aaf5f56c.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_af9697b6948a01bbd713c82c5ad453b3.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_af9697b6948a01bbd713c82c5ad453b3.png already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_8c3785ee64dc0d4dc9cfd0e67400a25f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_8c3785ee64dc0d4dc9cfd0e67400a25f.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_9d616d3b831b6cf3715177139afcd2ec.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_9d616d3b831b6cf3715177139afcd2ec.png already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fe3%252F6ee32bdc8192a0edcc781469240cdbd8%252Fpa%252FKC14104_1958b2c2c7893fa6a6a49283bc4fdba6.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_1958b2c2c7893fa6a6a49283bc4fdba6.png already downloaded
2025-12-05 17:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 33211055-6702-50e8-998c-d6415542e5a8, identifier: KC14104
2025-12-05 17:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 33211055-6702-50e8-998c-d6415542e5a8 with identifier: KC14104
2025-12-05 17:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 33211055-6702-50e8-998c-d6415542e5a8 with identifier: KC14104
2025-12-05 17:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 33211055-6702-50e8-998c-d6415542e5a8 spider: auto1.fr
2025-12-05 17:03:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 33211055-6702-50e8-998c-d6415542e5a8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2025-12-06T16:48:38Z',
'fuel_type': 'diesel',
'id': '33211055-6702-50e8-998c-d6415542e5a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC14104',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 86285,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_ab301a1bc8e1b1786cbc6f3ee753b141.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_c5d34c51dc51fcc2eaafd1f509b9f32f.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_42b2579cd4f1de1721a3fcf9b73063e4.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_1ea0be3bab584c8e20a4967b00c73be7.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_e9276f9d7ef838aa1a031855003931e4.jpg',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_0708dd4f5a001df52c50f4a232f83fa3.jpg',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_02f5b0f8f0ec3f6df27b22998e16683b.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_047ec235340b7df98acb062db7b8945e.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_ec734df21cc6d75feeb8d143aaf5f56c.jpg',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_af9697b6948a01bbd713c82c5ad453b3.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_8c3785ee64dc0d4dc9cfd0e67400a25f.jpg',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_9d616d3b831b6cf3715177139afcd2ec.png',
'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_1958b2c2c7893fa6a6a49283bc4fdba6.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_ab301a1bc8e1b1786cbc6f3ee753b141.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_c5d34c51dc51fcc2eaafd1f509b9f32f.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_42b2579cd4f1de1721a3fcf9b73063e4.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_1ea0be3bab584c8e20a4967b00c73be7.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218107,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_e9276f9d7ef838aa1a031855003931e4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_0708dd4f5a001df52c50f4a232f83fa3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_02f5b0f8f0ec3f6df27b22998e16683b.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_047ec235340b7df98acb062db7b8945e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148376,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_ec734df21cc6d75feeb8d143aaf5f56c.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_af9697b6948a01bbd713c82c5ad453b3.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_8c3785ee64dc0d4dc9cfd0e67400a25f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_11.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_9d616d3b831b6cf3715177139afcd2ec.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33211055-6702-50e8-998c-d6415542e5a8/33211055-6702-50e8-998c-d6415542e5a8_image_12.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/e3/6ee32bdc8192a0edcc781469240cdbd8/pa/KC14104_1958b2c2c7893fa6a6a49283bc4fdba6.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-23',
'seats_number': 2,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Club XL',
'transmission': 'manual',
'trim': 'Club XL',
'year': 2020}
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC14104%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [auto1.fr] INFO: Saving data for KC14104: {'created_time': 1764954227.428949, 'last_price_update_time': 1764954227.428958, 'auction_closing_time': 1765039718.0}
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KC14104') HTTP/1.1" 204 0
2025-12-05 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF86513> (referer: https://www.auto1.com/v1/car-details-view/RF86513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL28314> (referer: https://www.auto1.com/v1/car-details-view/PL28314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP33606> (referer: https://www.auto1.com/v1/car-details-view/FP33606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT20955> (referer: https://www.auto1.com/v1/car-details-view/AT20955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1db272-0915-5318-aedc-490bb95fe7c9 with identifier: HF68433
2025-12-05 17:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1db272-0915-5318-aedc-490bb95fe7c9 with scrape type 1
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3e1db272-0915-5318-aedc-490bb95fe7c9
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_b893b2ca92a42deeb8e76d968db4b76d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_b893b2ca92a42deeb8e76d968db4b76d.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_b13e2d6468e46069a50aff14d9c767f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_b13e2d6468e46069a50aff14d9c767f3.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_229823750d9c260ddd7b53b3d9f788a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_229823750d9c260ddd7b53b3d9f788a6.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_6edb482bbfb3722835d749e81b0e906b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_6edb482bbfb3722835d749e81b0e906b.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_fe13371d82c3d4d5627ee1fe86198694.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_fe13371d82c3d4d5627ee1fe86198694.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_dedc865dfda97068686b20f7a82333aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_dedc865dfda97068686b20f7a82333aa.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_4c0c956e73a988bd3d37b8af3dcde74e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_4c0c956e73a988bd3d37b8af3dcde74e.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_892e42ae3c26e68a21fce2e15399a44d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_892e42ae3c26e68a21fce2e15399a44d.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_a0a37d7ff8a62567f3d100b7eb7e2a65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_a0a37d7ff8a62567f3d100b7eb7e2a65.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_1706f52b89a58f79b5da807cf6f4ea67.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_1706f52b89a58f79b5da807cf6f4ea67.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_759368dc2f554927fdd17cf3b1888f24.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_759368dc2f554927fdd17cf3b1888f24.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_170bd0a25ccdf3a23c9164b3ac2cb99b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_170bd0a25ccdf3a23c9164b3ac2cb99b.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_133b9435b4226f16ee802bf3ae06dda3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_133b9435b4226f16ee802bf3ae06dda3.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_e12c605c873f495844888ba2463f287c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_e12c605c873f495844888ba2463f287c.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_1c99166d65b445f39f6f19d5b6ed6834.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_1c99166d65b445f39f6f19d5b6ed6834.jpg already downloaded
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F1d%252F001d413cfac732ca277ab50e43d057ba%252Fpa%252FHF68433_c359ae0044f6e690f7ab34b065f9701f.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_c359ae0044f6e690f7ab34b065f9701f.png already downloaded
2025-12-05 17:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e1db272-0915-5318-aedc-490bb95fe7c9, identifier: HF68433
2025-12-05 17:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dabcc1c-73cc-5d81-a81d-0a8818cad28f with identifier: TH90678
2025-12-05 17:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dabcc1c-73cc-5d81-a81d-0a8818cad28f with scrape type 2
2025-12-05 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dabcc1c-73cc-5d81-a81d-0a8818cad28f with scrape type 2
2025-12-05 17:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5dabcc1c-73cc-5d81-a81d-0a8818cad28f, identifier: TH90678
2025-12-05 17:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e1db272-0915-5318-aedc-490bb95fe7c9 with identifier: HF68433
2025-12-05 17:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e1db272-0915-5318-aedc-490bb95fe7c9 with identifier: HF68433
2025-12-05 17:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149465 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
149465
2025-12-05 17:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3e1db272-0915-5318-aedc-490bb95fe7c9 spider: auto1.fr
2025-12-05 17:03:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3e1db272-0915-5318-aedc-490bb95fe7c9 due to rule: high_mileage_for_make.json, error: 149465 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
149465
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2025-12-06T16:58:14Z',
'fuel_type': 'diesel',
'id': '3e1db272-0915-5318-aedc-490bb95fe7c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF68433',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Peugeot',
'model': '3008',
'odometer': 149465,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_b893b2ca92a42deeb8e76d968db4b76d.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_b13e2d6468e46069a50aff14d9c767f3.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_229823750d9c260ddd7b53b3d9f788a6.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_6edb482bbfb3722835d749e81b0e906b.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_fe13371d82c3d4d5627ee1fe86198694.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_dedc865dfda97068686b20f7a82333aa.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_4c0c956e73a988bd3d37b8af3dcde74e.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_892e42ae3c26e68a21fce2e15399a44d.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_a0a37d7ff8a62567f3d100b7eb7e2a65.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_1706f52b89a58f79b5da807cf6f4ea67.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_759368dc2f554927fdd17cf3b1888f24.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_170bd0a25ccdf3a23c9164b3ac2cb99b.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_133b9435b4226f16ee802bf3ae06dda3.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_e12c605c873f495844888ba2463f287c.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_1c99166d65b445f39f6f19d5b6ed6834.jpg',
'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_c359ae0044f6e690f7ab34b065f9701f.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_b893b2ca92a42deeb8e76d968db4b76d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_b13e2d6468e46069a50aff14d9c767f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_229823750d9c260ddd7b53b3d9f788a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_6edb482bbfb3722835d749e81b0e906b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_fe13371d82c3d4d5627ee1fe86198694.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_dedc865dfda97068686b20f7a82333aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_4c0c956e73a988bd3d37b8af3dcde74e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_892e42ae3c26e68a21fce2e15399a44d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_a0a37d7ff8a62567f3d100b7eb7e2a65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_1706f52b89a58f79b5da807cf6f4ea67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_759368dc2f554927fdd17cf3b1888f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_170bd0a25ccdf3a23c9164b3ac2cb99b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_133b9435b4226f16ee802bf3ae06dda3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_e12c605c873f495844888ba2463f287c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_1c99166d65b445f39f6f19d5b6ed6834.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1db272-0915-5318-aedc-490bb95fe7c9/3e1db272-0915-5318-aedc-490bb95fe7c9_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 83415,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img00/1d/001d413cfac732ca277ab50e43d057ba/pa/HF68433_c359ae0044f6e690f7ab34b065f9701f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF68433%27 HTTP/1.1" 200 None
2025-12-05 17:03:48 [auto1.fr] INFO: Saving data for HF68433: {'created_time': 1764954228.116939, 'last_price_update_time': 1764954228.11695, 'auction_closing_time': 1765040294.0}
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HF68433') HTTP/1.1" 204 0
2025-12-05 17:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5dabcc1c-73cc-5d81-a81d-0a8818cad28f with identifier: TH90678
2025-12-05 17:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5dabcc1c-73cc-5d81-a81d-0a8818cad28f with identifier: TH90678
2025-12-05 17:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5dabcc1c-73cc-5d81-a81d-0a8818cad28f with identifier: TH90678 to the API
2025-12-05 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH90678>
{'auction_title': '',
'c_o_2_emission_value': 65,
'category': 'Taxi',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 442,
'expiration_date': '2025-12-06T16:04:42Z',
'fuel_type': 'hybrid',
'id': '5dabcc1c-73cc-5d81-a81d-0a8818cad28f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH90678',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 146652,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 500e Plug-in Hybrid L',
'transmission': 'automatic',
'trim': 'L',
'year': 2017}
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH90678%27 HTTP/1.1" 200 None
2025-12-05 17:03:50 [auto1.fr] INFO: Saving data for TH90678: {'auction_closing_time': 1765037082.0, 'created_time': 1764263356.037144, 'last_price_update_time': 1764954230.198158}
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TH90678') HTTP/1.1" 204 0
2025-12-05 17:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK87277> (referer: https://www.auto1.com/v1/car-details-view/TK87277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA60540> (referer: https://www.auto1.com/v1/car-details-view/DA60540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae34971b-76c7-51fc-89fc-f0e97f30a495 with identifier: RF86513
2025-12-05 17:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae34971b-76c7-51fc-89fc-f0e97f30a495 with scrape type 2
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae34971b-76c7-51fc-89fc-f0e97f30a495 with scrape type 2
2025-12-05 17:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae34971b-76c7-51fc-89fc-f0e97f30a495, identifier: RF86513
2025-12-05 17:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58c1295-a10d-516b-8663-5d3a3c0c3613 with identifier: PL28314
2025-12-05 17:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58c1295-a10d-516b-8663-5d3a3c0c3613 with scrape type 1
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg not downloaded yet
2025-12-05 17:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca4867e0-547f-53c9-a9b2-2aed32772734 with identifier: FP33606
2025-12-05 17:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca4867e0-547f-53c9-a9b2-2aed32772734 with scrape type 2
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca4867e0-547f-53c9-a9b2-2aed32772734 with scrape type 2
2025-12-05 17:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca4867e0-547f-53c9-a9b2-2aed32772734, identifier: FP33606
2025-12-05 17:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1b68e41-5a9d-5f73-9d76-b07df24083af with identifier: AT20955
2025-12-05 17:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b68e41-5a9d-5f73-9d76-b07df24083af with scrape type 2
2025-12-05 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1b68e41-5a9d-5f73-9d76-b07df24083af with scrape type 2
2025-12-05 17:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1b68e41-5a9d-5f73-9d76-b07df24083af, identifier: AT20955
2025-12-05 17:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae34971b-76c7-51fc-89fc-f0e97f30a495 with identifier: RF86513
2025-12-05 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae34971b-76c7-51fc-89fc-f0e97f30a495 with identifier: RF86513
2025-12-05 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153276 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153276
2025-12-05 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ae34971b-76c7-51fc-89fc-f0e97f30a495 spider: auto1.fr
2025-12-05 17:03:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ae34971b-76c7-51fc-89fc-f0e97f30a495 due to rule: high_mileage_for_country.json, error: 153276 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153276
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2025-12-06T16:18:00Z',
'fuel_type': 'diesel',
'id': 'ae34971b-76c7-51fc-89fc-f0e97f30a495',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF86513',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 153276,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TDI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF86513%27 HTTP/1.1" 200 None
2025-12-05 17:03:50 [auto1.fr] INFO: Saving data for RF86513: {'auction_closing_time': 1765037880.0, 'created_time': 1761411828.323699, 'last_price_update_time': 1764954230.793407}
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RF86513') HTTP/1.1" 204 0
2025-12-05 17:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca4867e0-547f-53c9-a9b2-2aed32772734 with identifier: FP33606
2025-12-05 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca4867e0-547f-53c9-a9b2-2aed32772734 with identifier: FP33606
2025-12-05 17:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca4867e0-547f-53c9-a9b2-2aed32772734 with identifier: FP33606 to the API
2025-12-05 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP33606>
{'auction_title': '',
'c_o_2_emission_value': 47,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 261,
'expiration_date': '2025-12-06T16:30:34Z',
'fuel_type': 'hybrid',
'id': 'ca4867e0-547f-53c9-a9b2-2aed32772734',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP33606',
'listing': 'auction',
'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
'make': 'Volvo',
'model': 'XC40',
'odometer': 62786,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription Expression 2WD',
'transmission': 'automatic',
'trim': 'Inscription Expression 2WD',
'year': 2020}
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP33606%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [auto1.fr] INFO: Saving data for FP33606: {'auction_closing_time': 1765038634.0, 'created_time': 1764091017.249381, 'last_price_update_time': 1764954231.132171}
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP33606') HTTP/1.1" 204 0
2025-12-05 17:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1b68e41-5a9d-5f73-9d76-b07df24083af with identifier: AT20955
2025-12-05 17:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1b68e41-5a9d-5f73-9d76-b07df24083af with identifier: AT20955
2025-12-05 17:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 24013, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/at20955', 'expiration_date': '2025-12-06t16:59:53z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a1b68e41-5a9d-5f73-9d76-b07df24083af', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 24013}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:59:53z',
'fuel_type': 'petrol',
'id': 'a1b68e41-5a9d-5f73-9d76-b07df24083af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/at20955',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 24013,
'odometer_in_km': 24013,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-11',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2023}
2025-12-05 17:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a1b68e41-5a9d-5f73-9d76-b07df24083af spider: auto1.fr
2025-12-05 17:03:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a1b68e41-5a9d-5f73-9d76-b07df24083af due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 24013, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/at20955', 'expiration_date': '2025-12-06t16:59:53z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a1b68e41-5a9d-5f73-9d76-b07df24083af', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 24013}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:59:53z',
'fuel_type': 'petrol',
'id': 'a1b68e41-5a9d-5f73-9d76-b07df24083af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/at20955',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 24013,
'odometer_in_km': 24013,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-11',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:59:53Z',
'fuel_type': 'petrol',
'id': 'a1b68e41-5a9d-5f73-9d76-b07df24083af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT20955',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 24013,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech C-Series',
'transmission': 'manual',
'trim': 'C-Series',
'year': 2023}
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT20955%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [auto1.fr] INFO: Saving data for AT20955: {'auction_closing_time': 1765040393.0, 'created_time': 1764781865.654574, 'last_price_update_time': 1764954231.338209}
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AT20955') HTTP/1.1" 204 0
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_68833135505fd712b9e709f9a7558b0c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg not downloaded yet
2025-12-05 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB77810> (referer: https://www.auto1.com/v1/car-details-view/VB77810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2245adc4-a658-59f1-b93e-5d073ff554b5 with identifier: TK87277
2025-12-05 17:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2245adc4-a658-59f1-b93e-5d073ff554b5 with scrape type 2
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2245adc4-a658-59f1-b93e-5d073ff554b5 with scrape type 2
2025-12-05 17:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2245adc4-a658-59f1-b93e-5d073ff554b5, identifier: TK87277
2025-12-05 17:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ee1325-f1ba-5f44-9cf8-d261ed85b822 with identifier: DA60540
2025-12-05 17:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ee1325-f1ba-5f44-9cf8-d261ed85b822 with scrape type 1
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 97ee1325-f1ba-5f44-9cf8-d261ed85b822
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_da73166bac436ec9ce28a9fc08a4cd30.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_da73166bac436ec9ce28a9fc08a4cd30.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_f599b7904bcb0fe36cf2e9dd36f6f3c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_f599b7904bcb0fe36cf2e9dd36f6f3c0.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_e88edb7b287aeb3c283bd30be8ddf349.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_e88edb7b287aeb3c283bd30be8ddf349.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_794e939eee8e627a6a9dc4e365811e4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_794e939eee8e627a6a9dc4e365811e4a.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_db4446fe8b47ec2d811dbfda8c513aec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_db4446fe8b47ec2d811dbfda8c513aec.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_3e845be8f19e43786e7967b58bbcc780.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_3e845be8f19e43786e7967b58bbcc780.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_c374dbc7121277ef1dd3a0ea2eff7225.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_c374dbc7121277ef1dd3a0ea2eff7225.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_14bb209f6f224a562ab78482ec3b0dae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_14bb209f6f224a562ab78482ec3b0dae.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_2a324e062a5ae4a3a289f7b5fd1153bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_2a324e062a5ae4a3a289f7b5fd1153bc.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_4490670e0f202999b267af29c57ec824.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_4490670e0f202999b267af29c57ec824.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_0caf1628daaff23167b2c758a871a7bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0caf1628daaff23167b2c758a871a7bc.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_0b4b1f929c46602475cdd16c21ac1ed9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0b4b1f929c46602475cdd16c21ac1ed9.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_32b5b31c772e8d58c079555ef1c066e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_32b5b31c772e8d58c079555ef1c066e0.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_51e150c5b59e420c12cbc79268a7ced2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_51e150c5b59e420c12cbc79268a7ced2.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_c24b0b8402cdfc94782921ffb353b6b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_c24b0b8402cdfc94782921ffb353b6b5.jpg already downloaded
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fa5%252F8ea5d74be836548f036490dea3f6bedf%252Fpa%252FDA60540_0cb0768735dab92325fdd223d53e685c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0cb0768735dab92325fdd223d53e685c.jpg already downloaded
2025-12-05 17:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 97ee1325-f1ba-5f44-9cf8-d261ed85b822, identifier: DA60540
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_246020ffceb2ddc162229df97253f0dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg not downloaded yet
2025-12-05 17:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2245adc4-a658-59f1-b93e-5d073ff554b5 with identifier: TK87277
2025-12-05 17:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2245adc4-a658-59f1-b93e-5d073ff554b5 with identifier: TK87277
2025-12-05 17:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2245adc4-a658-59f1-b93e-5d073ff554b5 with identifier: TK87277 to the API
2025-12-05 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK87277>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:34:05Z',
'fuel_type': 'diesel',
'id': '2245adc4-a658-59f1-b93e-5d073ff554b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK87277',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'BMW',
'model': '1er',
'odometer': 72019,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d UrbanChic',
'transmission': 'automatic',
'trim': 'UrbanChic',
'year': 2019}
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK87277%27 HTTP/1.1" 200 None
2025-12-05 17:03:52 [auto1.fr] INFO: Saving data for TK87277: {'auction_closing_time': 1765038845.0, 'created_time': 1764669838.642614, 'last_price_update_time': 1764954232.182716}
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK87277') HTTP/1.1" 204 0
2025-12-05 17:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 97ee1325-f1ba-5f44-9cf8-d261ed85b822 with identifier: DA60540
2025-12-05 17:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 97ee1325-f1ba-5f44-9cf8-d261ed85b822 with identifier: DA60540
2025-12-05 17:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 97ee1325-f1ba-5f44-9cf8-d261ed85b822 with identifier: DA60540 to the API
2025-12-05 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA60540>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 309,
'expiration_date': '2025-12-06T16:57:31Z',
'fuel_type': 'hybrid',
'id': '97ee1325-f1ba-5f44-9cf8-d261ed85b822',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA60540',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 26348,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_da73166bac436ec9ce28a9fc08a4cd30.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_f599b7904bcb0fe36cf2e9dd36f6f3c0.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_e88edb7b287aeb3c283bd30be8ddf349.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_794e939eee8e627a6a9dc4e365811e4a.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_db4446fe8b47ec2d811dbfda8c513aec.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_3e845be8f19e43786e7967b58bbcc780.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_c374dbc7121277ef1dd3a0ea2eff7225.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_14bb209f6f224a562ab78482ec3b0dae.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_2a324e062a5ae4a3a289f7b5fd1153bc.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_4490670e0f202999b267af29c57ec824.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0caf1628daaff23167b2c758a871a7bc.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0b4b1f929c46602475cdd16c21ac1ed9.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_32b5b31c772e8d58c079555ef1c066e0.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_51e150c5b59e420c12cbc79268a7ced2.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_c24b0b8402cdfc94782921ffb353b6b5.jpg',
'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0cb0768735dab92325fdd223d53e685c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_da73166bac436ec9ce28a9fc08a4cd30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_f599b7904bcb0fe36cf2e9dd36f6f3c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_e88edb7b287aeb3c283bd30be8ddf349.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_794e939eee8e627a6a9dc4e365811e4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_db4446fe8b47ec2d811dbfda8c513aec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_3e845be8f19e43786e7967b58bbcc780.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_c374dbc7121277ef1dd3a0ea2eff7225.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_14bb209f6f224a562ab78482ec3b0dae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_2a324e062a5ae4a3a289f7b5fd1153bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_4490670e0f202999b267af29c57ec824.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0caf1628daaff23167b2c758a871a7bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0b4b1f929c46602475cdd16c21ac1ed9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_32b5b31c772e8d58c079555ef1c066e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_51e150c5b59e420c12cbc79268a7ced2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_c24b0b8402cdfc94782921ffb353b6b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ee1325-f1ba-5f44-9cf8-d261ed85b822/97ee1325-f1ba-5f44-9cf8-d261ed85b822_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/a5/8ea5d74be836548f036490dea3f6bedf/pa/DA60540_0cb0768735dab92325fdd223d53e685c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque P300e Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2021}
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA60540%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [auto1.fr] INFO: Saving data for DA60540: {'created_time': 1764954233.658475, 'last_price_update_time': 1764954233.658486, 'auction_closing_time': 1765040251.0}
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA60540') HTTP/1.1" 204 0
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_edfacc6639d054a9db717ecf86ee7fef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg not downloaded yet
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ55332> (referer: https://www.auto1.com/v1/car-details-view/GZ55332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ66404> (referer: https://www.auto1.com/v1/car-details-view/WJ66404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN66088> (referer: https://www.auto1.com/v1/car-details-view/KN66088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT08922> (referer: https://www.auto1.com/v1/car-details-view/PT08922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_34d0c5d84e197267cd1fd03300d00c17.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg not downloaded yet
2025-12-05 17:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8dd928-aad1-51fa-860e-5769eb526675 with identifier: VB77810
2025-12-05 17:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8dd928-aad1-51fa-860e-5769eb526675 with scrape type 1
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_012711f5fb13261106b178c16ffa660d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_012711f5fb13261106b178c16ffa660d.jpg not downloaded yet
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg not downloaded yet
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_c960995721421e9ce28372383a3b5b4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c960995721421e9ce28372383a3b5b4f.jpg not downloaded yet
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg not downloaded yet
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_5938c2d162a3c7a3b8b3932bae3685bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5938c2d162a3c7a3b8b3932bae3685bd.jpg not downloaded yet
2025-12-05 17:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_14666d9375d70167ec87b25c2e0f5d63.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg not downloaded yet
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_22fd49243170d25aed5bdf5dbf4607d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_22fd49243170d25aed5bdf5dbf4607d0.jpg not downloaded yet
2025-12-05 17:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c4a78af-0bae-5dfa-93a6-60938cadd9f3 with identifier: GZ55332
2025-12-05 17:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c4a78af-0bae-5dfa-93a6-60938cadd9f3 with scrape type 2
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c4a78af-0bae-5dfa-93a6-60938cadd9f3 with scrape type 2
2025-12-05 17:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4c4a78af-0bae-5dfa-93a6-60938cadd9f3, identifier: GZ55332
2025-12-05 17:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 991883c3-e927-5d93-8938-b4de249d117d with identifier: WJ66404
2025-12-05 17:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 991883c3-e927-5d93-8938-b4de249d117d with scrape type 2
2025-12-05 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 991883c3-e927-5d93-8938-b4de249d117d with scrape type 2
2025-12-05 17:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 991883c3-e927-5d93-8938-b4de249d117d, identifier: WJ66404
2025-12-05 17:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aa6a891-d330-51ce-b9ff-d0104a3c2394 with identifier: KN66088
2025-12-05 17:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa6a891-d330-51ce-b9ff-d0104a3c2394 with scrape type 2
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aa6a891-d330-51ce-b9ff-d0104a3c2394 with scrape type 2
2025-12-05 17:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5aa6a891-d330-51ce-b9ff-d0104a3c2394, identifier: KN66088
2025-12-05 17:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4954da50-95ea-5b66-af2b-a14b3cc0067b with identifier: PT08922
2025-12-05 17:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4954da50-95ea-5b66-af2b-a14b3cc0067b with scrape type 2
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4954da50-95ea-5b66-af2b-a14b3cc0067b with scrape type 2
2025-12-05 17:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4954da50-95ea-5b66-af2b-a14b3cc0067b, identifier: PT08922
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg not downloaded yet
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_cc2d7fb7bb355bdf399665affbd65ddf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cc2d7fb7bb355bdf399665affbd65ddf.jpg not downloaded yet
2025-12-05 17:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4c4a78af-0bae-5dfa-93a6-60938cadd9f3 with identifier: GZ55332
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4c4a78af-0bae-5dfa-93a6-60938cadd9f3 with identifier: GZ55332
2025-12-05 17:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4c4a78af-0bae-5dfa-93a6-60938cadd9f3 with identifier: GZ55332 to the API
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%274c4a78af-0bae-5dfa-93a6-60938cadd9f3%27 HTTP/1.1" 200 None
2025-12-05 17:03:54 [crawlers.pipelines.post_to_api] ERROR: auto1.fr, item_id 4c4a78af-0bae-5dfa-93a6-60938cadd9f3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 17:03:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2025-12-05 17:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ55332>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:12:26Z',
'fuel_type': 'petrol',
'id': '4c4a78af-0bae-5dfa-93a6-60938cadd9f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ55332',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 116609,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 30 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ55332%27 HTTP/1.1" 200 None
2025-12-05 17:03:54 [auto1.fr] INFO: Saving data for GZ55332: {'auction_closing_time': 1765037546.0, 'created_time': 1762275758.595386, 'last_price_update_time': 1764954234.59482}
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ55332') HTTP/1.1" 204 0
2025-12-05 17:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 991883c3-e927-5d93-8938-b4de249d117d with identifier: WJ66404
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 991883c3-e927-5d93-8938-b4de249d117d with identifier: WJ66404
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 32643, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wj66404', 'expiration_date': '2025-12-06t16:51:44z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '991883c3-e927-5d93-8938-b4de249d117d', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 32643}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:51:44z',
'fuel_type': 'petrol',
'id': '991883c3-e927-5d93-8938-b4de249d117d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wj66404',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 32643,
'odometer_in_km': 32643,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-05',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 991883c3-e927-5d93-8938-b4de249d117d spider: auto1.fr
2025-12-05 17:03:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 991883c3-e927-5d93-8938-b4de249d117d due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 32643, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wj66404', 'expiration_date': '2025-12-06t16:51:44z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '991883c3-e927-5d93-8938-b4de249d117d', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 32643}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:51:44z',
'fuel_type': 'petrol',
'id': '991883c3-e927-5d93-8938-b4de249d117d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wj66404',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 32643,
'odometer_in_km': 32643,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-05',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:51:44Z',
'fuel_type': 'petrol',
'id': '991883c3-e927-5d93-8938-b4de249d117d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ66404',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 32643,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ66404%27 HTTP/1.1" 200 None
2025-12-05 17:03:54 [auto1.fr] INFO: Saving data for WJ66404: {'auction_closing_time': 1765039904.0, 'created_time': 1764782012.332656, 'last_price_update_time': 1764954234.822148}
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ66404') HTTP/1.1" 204 0
2025-12-05 17:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5aa6a891-d330-51ce-b9ff-d0104a3c2394 with identifier: KN66088
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5aa6a891-d330-51ce-b9ff-d0104a3c2394 with identifier: KN66088
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173529 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173529
2025-12-05 17:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5aa6a891-d330-51ce-b9ff-d0104a3c2394 spider: auto1.fr
2025-12-05 17:03:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5aa6a891-d330-51ce-b9ff-d0104a3c2394 due to rule: high_mileage_for_country.json, error: 173529 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173529
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:50:09Z',
'fuel_type': 'diesel',
'id': '5aa6a891-d330-51ce-b9ff-d0104a3c2394',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN66088',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 173529,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Business 2WD',
'transmission': 'automatic',
'trim': 'Business 2WD',
'year': 2017}
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN66088%27 HTTP/1.1" 200 None
2025-12-05 17:03:55 [auto1.fr] INFO: Saving data for KN66088: {'auction_closing_time': 1765039809.0, 'created_time': 1764263144.807585, 'last_price_update_time': 1764954235.040457}
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KN66088') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4954da50-95ea-5b66-af2b-a14b3cc0067b with identifier: PT08922
2025-12-05 17:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4954da50-95ea-5b66-af2b-a14b3cc0067b with identifier: PT08922
2025-12-05 17:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.6 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 148924, 'odometer_reading_unit': 'km', 'registration_date': '2018-11-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pt08922', 'expiration_date': '2025-12-06t16:34:27z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '4954da50-95ea-5b66-af2b-a14b3cc0067b', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 148924}
Failed validating None in schema:
False
On instance:
{'age_in_months': 84,
'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'engine_horse_power': 181,
'expiration_date': '2025-12-06t16:34:27z',
'fuel_type': 'petrol',
'id': '4954da50-95ea-5b66-af2b-a14b3cc0067b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pt08922',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 148924,
'odometer_in_km': 148924,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.6 puretech gt line',
'transmission': 'automatic',
'trim': 'gt line',
'year': 2018}
2025-12-05 17:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4954da50-95ea-5b66-af2b-a14b3cc0067b spider: auto1.fr
2025-12-05 17:03:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4954da50-95ea-5b66-af2b-a14b3cc0067b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.6 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 148924, 'odometer_reading_unit': 'km', 'registration_date': '2018-11-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pt08922', 'expiration_date': '2025-12-06t16:34:27z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '4954da50-95ea-5b66-af2b-a14b3cc0067b', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 148924}
Failed validating None in schema:
False
On instance:
{'age_in_months': 84,
'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'engine_horse_power': 181,
'expiration_date': '2025-12-06t16:34:27z',
'fuel_type': 'petrol',
'id': '4954da50-95ea-5b66-af2b-a14b3cc0067b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pt08922',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 148924,
'odometer_in_km': 148924,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.6 puretech gt line',
'transmission': 'automatic',
'trim': 'gt line',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 181,
'expiration_date': '2025-12-06T16:34:27Z',
'fuel_type': 'petrol',
'id': '4954da50-95ea-5b66-af2b-a14b3cc0067b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT08922',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Peugeot',
'model': '3008',
'odometer': 148924,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 PureTech GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT08922%27 HTTP/1.1" 200 None
2025-12-05 17:03:55 [auto1.fr] INFO: Saving data for PT08922: {'auction_closing_time': 1765038867.0, 'created_time': 1762337464.952682, 'last_price_update_time': 1764954235.262747}
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PT08922') HTTP/1.1" 204 0
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg not downloaded yet
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_cd68f6577898025146231e3c75c471e3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cd68f6577898025146231e3c75c471e3.jpg not downloaded yet
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e353d0>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY66353> (referer: https://www.auto1.com/v1/car-details-view/RY66353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC10323> (referer: https://www.auto1.com/v1/car-details-view/VC10323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg not downloaded yet
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_fd4d46e2ccf631661db7613f704c939c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fd4d46e2ccf631661db7613f704c939c.jpg not downloaded yet
2025-12-05 17:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5938c2d162a3c7a3b8b3932bae3685bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a7010>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_edfacc6639d054a9db717ecf86ee7fef.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg saved to cache
2025-12-05 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd5f10>
2025-12-05 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_68833135505fd712b9e709f9a7558b0c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg saved to cache
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5af9950>
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_246020ffceb2ddc162229df97253f0dd.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg saved to cache
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_96c95184eae85609baadc694b0ed8846.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg not downloaded yet
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_3562d31204ac31cf880c13204c264fc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_3562d31204ac31cf880c13204c264fc6.jpg not downloaded yet
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_22fd49243170d25aed5bdf5dbf4607d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cc2d7fb7bb355bdf399665affbd65ddf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_f64a1a8f7a3524d1c304201dd6921966.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg not downloaded yet
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_c6cf1898cd6d99a27fd5b047504a0ce3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c6cf1898cd6d99a27fd5b047504a0ce3.jpg not downloaded yet
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK69259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT62389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE55145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC69297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a with identifier: RY66353
2025-12-05 17:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a with scrape type 2
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a with scrape type 2
2025-12-05 17:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a, identifier: RY66353
2025-12-05 17:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da211a4a-a22b-573f-84e7-d0b43d79fc6b with identifier: VC10323
2025-12-05 17:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da211a4a-a22b-573f-84e7-d0b43d79fc6b with scrape type 2
2025-12-05 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da211a4a-a22b-573f-84e7-d0b43d79fc6b with scrape type 2
2025-12-05 17:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da211a4a-a22b-573f-84e7-d0b43d79fc6b, identifier: VC10323
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c61f90>
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_5938c2d162a3c7a3b8b3932bae3685bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5938c2d162a3c7a3b8b3932bae3685bd.jpg saved to cache
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a with identifier: RY66353
2025-12-05 17:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a with identifier: RY66353
2025-12-05 17:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3a4d35f9-4c29-5dbe-acaa-4c1b4945592a with identifier: RY66353 to the API
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY66353>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:56:30Z',
'fuel_type': 'petrol',
'id': '3a4d35f9-4c29-5dbe-acaa-4c1b4945592a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY66353',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 19633,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-19',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY66353%27 HTTP/1.1" 200 None
2025-12-05 17:03:57 [auto1.fr] INFO: Saving data for RY66353: {'auction_closing_time': 1765040190.0, 'created_time': 1764782010.022894, 'last_price_update_time': 1764954237.333323}
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY66353') HTTP/1.1" 204 0
2025-12-05 17:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da211a4a-a22b-573f-84e7-d0b43d79fc6b with identifier: VC10323
2025-12-05 17:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da211a4a-a22b-573f-84e7-d0b43d79fc6b with identifier: VC10323
2025-12-05 17:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da211a4a-a22b-573f-84e7-d0b43d79fc6b with identifier: VC10323 to the API
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VC10323>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:27:10Z',
'fuel_type': 'hybrid',
'id': 'da211a4a-a22b-573f-84e7-d0b43d79fc6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC10323',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Peugeot',
'model': '3008',
'odometer': 55952,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
'transmission': 'automatic',
'trim': 'GT Pack',
'year': 2021}
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC10323%27 HTTP/1.1" 200 None
2025-12-05 17:03:57 [auto1.fr] INFO: Saving data for VC10323: {'auction_closing_time': 1765038430.0, 'created_time': 1763704842.813497, 'last_price_update_time': 1764954237.674453}
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VC10323') HTTP/1.1" 204 0
2025-12-05 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cd68f6577898025146231e3c75c471e3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg not downloaded yet
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_5a9113c489934c8027177ed5c9d47094.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5a9113c489934c8027177ed5c9d47094.jpg not downloaded yet
2025-12-05 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL29400> (referer: https://www.auto1.com/v1/car-details-view/YL29400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd48d0>
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_22fd49243170d25aed5bdf5dbf4607d0.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_22fd49243170d25aed5bdf5dbf4607d0.jpg saved to cache
2025-12-05 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57823d0>
2025-12-05 17:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_cc2d7fb7bb355bdf399665affbd65ddf.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cc2d7fb7bb355bdf399665affbd65ddf.jpg saved to cache
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5783750>
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg saved to cache
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg not downloaded yet
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_31bdfa6f27f0fcc29b1d72c918b4514e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_31bdfa6f27f0fcc29b1d72c918b4514e.jpg not downloaded yet
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fd4d46e2ccf631661db7613f704c939c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_3562d31204ac31cf880c13204c264fc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c960995721421e9ce28372383a3b5b4f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_7b20c55c1e5be04ed9456e7cfed0118d.png%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png not downloaded yet
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_fbb7d74c464561096903278c8a1705e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fbb7d74c464561096903278c8a1705e2.jpg not downloaded yet
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH41578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW68011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d61150>
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_cd68f6577898025146231e3c75c471e3.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cd68f6577898025146231e3c75c471e3.jpg saved to cache
2025-12-05 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d0e150>
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg saved to cache
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f14c10>
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_14666d9375d70167ec87b25c2e0f5d63.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg saved to cache
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bffa652a-21d9-52c5-a310-fc5154e97262 with identifier: YL29400
2025-12-05 17:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bffa652a-21d9-52c5-a310-fc5154e97262 with scrape type 1
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg not downloaded yet
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c6cf1898cd6d99a27fd5b047504a0ce3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_5dde0bf62a0fefb2cb5cfad85b49bef5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5dde0bf62a0fefb2cb5cfad85b49bef5.jpg not downloaded yet
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_012711f5fb13261106b178c16ffa660d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg not downloaded yet
2025-12-05 17:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_56576135561d5d9aa21d8a94563421a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_56576135561d5d9aa21d8a94563421a5.jpg not downloaded yet
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e67b50>
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg saved to cache
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d09210>
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_fd4d46e2ccf631661db7613f704c939c.jpg') HTTP/1.1" 204 0
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fd4d46e2ccf631661db7613f704c939c.jpg saved to cache
2025-12-05 17:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a088d0>
2025-12-05 17:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_3562d31204ac31cf880c13204c264fc6.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_3562d31204ac31cf880c13204c264fc6.jpg saved to cache
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5847c50>
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_c960995721421e9ce28372383a3b5b4f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c960995721421e9ce28372383a3b5b4f.jpg saved to cache
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5845fd0>
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_96c95184eae85609baadc694b0ed8846.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg saved to cache
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1cb10>
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg saved to cache
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_8b12cf4e0e213b229467f717fcd62377.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg not downloaded yet
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5a9113c489934c8027177ed5c9d47094.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_31bdfa6f27f0fcc29b1d72c918b4514e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_c271f3ebba55a1460524ea8de7c0ab96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c271f3ebba55a1460524ea8de7c0ab96.jpg not downloaded yet
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_756b5a8ef789a8356713ed967424ca5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg not downloaded yet
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE20714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP06562/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a90550>
2025-12-05 17:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_c6cf1898cd6d99a27fd5b047504a0ce3.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c6cf1898cd6d99a27fd5b047504a0ce3.jpg saved to cache
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a84a10>
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_f64a1a8f7a3524d1c304201dd6921966.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg saved to cache
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cc2d50>
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_012711f5fb13261106b178c16ffa660d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_012711f5fb13261106b178c16ffa660d.jpg saved to cache
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df5c10>
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg saved to cache
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fbb7d74c464561096903278c8a1705e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5dde0bf62a0fefb2cb5cfad85b49bef5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_e4dcf75d74dcb72078583fadb04b9a62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_e4dcf75d74dcb72078583fadb04b9a62.jpg not downloaded yet
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg not downloaded yet
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_76336bd499e70260a3ecb2891d418a43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_76336bd499e70260a3ecb2891d418a43.jpg not downloaded yet
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC69297> (referer: https://www.auto1.com/v1/car-details-view/VC69297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT62389> (referer: https://www.auto1.com/v1/car-details-view/HT62389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE55145> (referer: https://www.auto1.com/v1/car-details-view/DE55145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a4ef50>
2025-12-05 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg saved to cache
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e0650>
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_5a9113c489934c8027177ed5c9d47094.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5a9113c489934c8027177ed5c9d47094.jpg saved to cache
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583ca90>
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_31bdfa6f27f0fcc29b1d72c918b4514e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_31bdfa6f27f0fcc29b1d72c918b4514e.jpg saved to cache
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585cb50>
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg saved to cache
2025-12-05 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cd6d0>
2025-12-05 17:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_34d0c5d84e197267cd1fd03300d00c17.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg saved to cache
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg not downloaded yet
2025-12-05 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_845f3e346aa5fe9ead0e6c67b382a5e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_845f3e346aa5fe9ead0e6c67b382a5e1.jpg not downloaded yet
2025-12-05 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_56576135561d5d9aa21d8a94563421a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c271f3ebba55a1460524ea8de7c0ab96.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png> (referer: https://www.auto1.com/)
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_08d806cc408a0b58031842ea190c6481.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg not downloaded yet
2025-12-05 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK69259> (referer: https://www.auto1.com/v1/car-details-view/NK69259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_2c397fbec4dd4216f6907c444581c345.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_2c397fbec4dd4216f6907c444581c345.jpg not downloaded yet
2025-12-05 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d17a10>
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_fbb7d74c464561096903278c8a1705e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fbb7d74c464561096903278c8a1705e2.jpg saved to cache
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e0350>
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_5dde0bf62a0fefb2cb5cfad85b49bef5.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5dde0bf62a0fefb2cb5cfad85b49bef5.jpg saved to cache
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd71d2bb-dd71-5c06-9afa-aabc00d24bab with identifier: VC69297
2025-12-05 17:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd71d2bb-dd71-5c06-9afa-aabc00d24bab with scrape type 2
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd71d2bb-dd71-5c06-9afa-aabc00d24bab with scrape type 2
2025-12-05 17:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dd71d2bb-dd71-5c06-9afa-aabc00d24bab, identifier: VC69297
2025-12-05 17:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f407d38-9d40-5a08-84c5-6b80ab7372f8 with identifier: HT62389
2025-12-05 17:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f407d38-9d40-5a08-84c5-6b80ab7372f8 with scrape type 2
2025-12-05 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f407d38-9d40-5a08-84c5-6b80ab7372f8 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f407d38-9d40-5a08-84c5-6b80ab7372f8, identifier: HT62389
2025-12-05 17:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 with identifier: DE55145
2025-12-05 17:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 with scrape type 2
2025-12-05 17:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91, identifier: DE55145
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg not downloaded yet
2025-12-05 17:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dd71d2bb-dd71-5c06-9afa-aabc00d24bab with identifier: VC69297
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dd71d2bb-dd71-5c06-9afa-aabc00d24bab with identifier: VC69297
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172150 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172150
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dd71d2bb-dd71-5c06-9afa-aabc00d24bab spider: auto1.fr
2025-12-05 17:04:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: dd71d2bb-dd71-5c06-9afa-aabc00d24bab due to rule: high_mileage_for_country.json, error: 172150 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
172150
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:34:57Z',
'fuel_type': 'diesel',
'id': 'dd71d2bb-dd71-5c06-9afa-aabc00d24bab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC69297',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Peugeot',
'model': '5008',
'odometer': 172150,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-17',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2018}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC69297%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [auto1.fr] INFO: Saving data for VC69297: {'auction_closing_time': 1765038897.0, 'created_time': 1764608457.34858, 'last_price_update_time': 1764954244.361204}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VC69297') HTTP/1.1" 204 0
2025-12-05 17:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f407d38-9d40-5a08-84c5-6b80ab7372f8 with identifier: HT62389
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f407d38-9d40-5a08-84c5-6b80ab7372f8 with identifier: HT62389
2025-12-05 17:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f407d38-9d40-5a08-84c5-6b80ab7372f8 with identifier: HT62389 to the API
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT62389>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:05:06Z',
'fuel_type': 'petrol',
'id': '9f407d38-9d40-5a08-84c5-6b80ab7372f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT62389',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 5924,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-21',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT62389%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [auto1.fr] INFO: Saving data for HT62389: {'auction_closing_time': 1765037106.0, 'created_time': 1764781963.355649, 'last_price_update_time': 1764954244.667331}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT62389') HTTP/1.1" 204 0
2025-12-05 17:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 with identifier: DE55145
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 with identifier: DE55145
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 28523, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de55145', 'expiration_date': '2025-12-06t16:31:19z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 28523}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:31:19z',
'fuel_type': 'petrol',
'id': '1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de55145',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 28523,
'odometer_in_km': 28523,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 spider: auto1.fr
2025-12-05 17:04:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 28523, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de55145', 'expiration_date': '2025-12-06t16:31:19z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 28523}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:31:19z',
'fuel_type': 'petrol',
'id': '1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de55145',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 28523,
'odometer_in_km': 28523,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:31:19Z',
'fuel_type': 'petrol',
'id': '1dced7f5-b7ae-5ce3-b4da-fafb4a52ba91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE55145',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 28523,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE55145%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [auto1.fr] INFO: Saving data for DE55145: {'auction_closing_time': 1765038679.0, 'created_time': 1764782204.166319, 'last_price_update_time': 1764954244.891309}
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE55145') HTTP/1.1" 204 0
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_76336bd499e70260a3ecb2891d418a43.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_f3c89a10fa644ab00de2ac5d01834165.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_f3c89a10fa644ab00de2ac5d01834165.jpg not downloaded yet
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_e4dcf75d74dcb72078583fadb04b9a62.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_62925c549c4e093aee808b8c51cfaa1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg not downloaded yet
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW68011> (referer: https://www.auto1.com/v1/car-details-view/CW68011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC19124> (referer: https://www.auto1.com/v1/car-details-view/YC19124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5883590>
2025-12-05 17:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_56576135561d5d9aa21d8a94563421a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_56576135561d5d9aa21d8a94563421a5.jpg saved to cache
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58982d0>
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_c271f3ebba55a1460524ea8de7c0ab96.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c271f3ebba55a1460524ea8de7c0ab96.jpg saved to cache
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:04:05 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:04:05 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:04:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e258d0>
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_15.png HTTP/1.1" 201 0
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F81%252Fdf8176d4a268f8f5c81198892b9fad4c%252Fpa%252FPL28314_7b20c55c1e5be04ed9456e7cfed0118d.png') HTTP/1.1" 204 0
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png saved to cache
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c58c1295-a10d-516b-8663-5d3a3c0c3613
2025-12-05 17:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c58c1295-a10d-516b-8663-5d3a3c0c3613, skipping ID generation
2025-12-05 17:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58c1295-a10d-516b-8663-5d3a3c0c3613 with scrape type 1
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c58c1295-a10d-516b-8663-5d3a3c0c3613 from tracking dictionaries
2025-12-05 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c58c1295-a10d-516b-8663-5d3a3c0c3613 sending to next pipeline
2025-12-05 17:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c58c1295-a10d-516b-8663-5d3a3c0c3613, identifier: PL28314
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5adbb10>
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg saved to cache
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5297fd5f-bf92-5646-992a-ccc6ac524b20 with identifier: NK69259
2025-12-05 17:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5297fd5f-bf92-5646-992a-ccc6ac524b20 with scrape type 2
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5297fd5f-bf92-5646-992a-ccc6ac524b20 with scrape type 2
2025-12-05 17:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5297fd5f-bf92-5646-992a-ccc6ac524b20, identifier: NK69259
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_845f3e346aa5fe9ead0e6c67b382a5e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c58c1295-a10d-516b-8663-5d3a3c0c3613 with identifier: PL28314
2025-12-05 17:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c58c1295-a10d-516b-8663-5d3a3c0c3613 with identifier: PL28314
2025-12-05 17:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'manual', 'odometer': 23942, 'odometer_reading_unit': 'km', 'registration_date': '2024-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl28314', 'expiration_date': '2025-12-06t16:49:33z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, brive-la-gaillarde', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'c58c1295-a10d-516b-8663-5d3a3c0c3613', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67537}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59706}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72113}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64123}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71979}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66162}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66602}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49140}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100804}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 73720}], 'current_year_diff': 1, 'age_in_months': 17, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 23942}
Failed validating None in schema:
False
On instance:
{'age_in_months': 17,
'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:49:33z',
'fuel_type': 'petrol',
'id': 'c58c1295-a10d-516b-8663-5d3a3c0c3613',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl28314',
'listing': 'auction',
'location': 'fr, brive-la-gaillarde',
'make': 'opel',
'make_model': 'opel mokka x',
'model': 'mokka x',
'odometer': 23942,
'odometer_in_km': 23942,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 73720,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-27',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel mokka x 1.2 turbo elegance',
'transmission': 'manual',
'trim': 'elegance',
'year': 2024}
2025-12-05 17:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: c58c1295-a10d-516b-8663-5d3a3c0c3613 spider: auto1.fr
2025-12-05 17:04:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c58c1295-a10d-516b-8663-5d3a3c0c3613 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'manual', 'odometer': 23942, 'odometer_reading_unit': 'km', 'registration_date': '2024-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl28314', 'expiration_date': '2025-12-06t16:49:33z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, brive-la-gaillarde', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'c58c1295-a10d-516b-8663-5d3a3c0c3613', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67537}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59706}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72113}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64123}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71979}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66162}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66602}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49140}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100804}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 73720}], 'current_year_diff': 1, 'age_in_months': 17, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 23942}
Failed validating None in schema:
False
On instance:
{'age_in_months': 17,
'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 1,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:49:33z',
'fuel_type': 'petrol',
'id': 'c58c1295-a10d-516b-8663-5d3a3c0c3613',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl28314',
'listing': 'auction',
'location': 'fr, brive-la-gaillarde',
'make': 'opel',
'make_model': 'opel mokka x',
'model': 'mokka x',
'odometer': 23942,
'odometer_in_km': 23942,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 73720,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-27',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel mokka x 1.2 turbo elegance',
'transmission': 'manual',
'trim': 'elegance',
'year': 2024}
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:49:33Z',
'fuel_type': 'petrol',
'id': 'c58c1295-a10d-516b-8663-5d3a3c0c3613',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL28314',
'listing': 'auction',
'location': 'FR, Brive-la-Gaillarde',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 23942,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_22d53619aebf7ca78c59ea7edcc483d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_68833135505fd712b9e709f9a7558b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_246020ffceb2ddc162229df97253f0dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_edfacc6639d054a9db717ecf86ee7fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_34d0c5d84e197267cd1fd03300d00c17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_9f46c7b4c579d3d854a13baa89cbd542.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_c2f2f5f2fcc67441804c88c801e0b739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_14666d9375d70167ec87b25c2e0f5d63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_bb4984a8855a1f0e2fc148ca9d2ae90a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7a3fc14e069cbdd5c71447e55a3f04ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_5d64ff199a0d297aa8fac69e02f135ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_96c95184eae85609baadc694b0ed8846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_f64a1a8f7a3524d1c304201dd6921966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_4ecc423f4d37bceb05a554f9d650b9e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_288a6e5f2f8e5c53b77ce04fb327e93f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58c1295-a10d-516b-8663-5d3a3c0c3613/c58c1295-a10d-516b-8663-5d3a3c0c3613_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 73720,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/81/df8176d4a268f8f5c81198892b9fad4c/pa/PL28314_7b20c55c1e5be04ed9456e7cfed0118d.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2024}
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL28314%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [auto1.fr] INFO: Saving data for PL28314: {'created_time': 1764954246.351786, 'last_price_update_time': 1764954246.351796, 'auction_closing_time': 1765039773.0}
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PL28314') HTTP/1.1" 204 0
2025-12-05 17:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5297fd5f-bf92-5646-992a-ccc6ac524b20 with identifier: NK69259
2025-12-05 17:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5297fd5f-bf92-5646-992a-ccc6ac524b20 with identifier: NK69259
2025-12-05 17:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 25074, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk69259', 'expiration_date': '2025-12-06t16:14:17z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '5297fd5f-bf92-5646-992a-ccc6ac524b20', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 25074}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:14:17z',
'fuel_type': 'petrol',
'id': '5297fd5f-bf92-5646-992a-ccc6ac524b20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk69259',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 25074,
'odometer_in_km': 25074,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-31',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 5297fd5f-bf92-5646-992a-ccc6ac524b20 spider: auto1.fr
2025-12-05 17:04:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5297fd5f-bf92-5646-992a-ccc6ac524b20 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 25074, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk69259', 'expiration_date': '2025-12-06t16:14:17z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '5297fd5f-bf92-5646-992a-ccc6ac524b20', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 25074}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:14:17z',
'fuel_type': 'petrol',
'id': '5297fd5f-bf92-5646-992a-ccc6ac524b20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk69259',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 25074,
'odometer_in_km': 25074,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-31',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:14:17Z',
'fuel_type': 'petrol',
'id': '5297fd5f-bf92-5646-992a-ccc6ac524b20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK69259',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 25074,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK69259%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [auto1.fr] INFO: Saving data for NK69259: {'auction_closing_time': 1765037657.0, 'created_time': 1764781877.348949, 'last_price_update_time': 1764954246.57641}
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK69259') HTTP/1.1" 204 0
2025-12-05 17:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_df85c4f0144fa195d6d0e514dea1a219.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg not downloaded yet
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB63635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH41578> (referer: https://www.auto1.com/v1/car-details-view/SH41578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5989090>
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_76336bd499e70260a3ecb2891d418a43.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_76336bd499e70260a3ecb2891d418a43.jpg saved to cache
2025-12-05 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5aebb90>
2025-12-05 17:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_e4dcf75d74dcb72078583fadb04b9a62.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_e4dcf75d74dcb72078583fadb04b9a62.jpg saved to cache
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a7eda1f-b91c-5052-82ef-2d3f5332a563 with identifier: CW68011
2025-12-05 17:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a7eda1f-b91c-5052-82ef-2d3f5332a563 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a7eda1f-b91c-5052-82ef-2d3f5332a563 with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a7eda1f-b91c-5052-82ef-2d3f5332a563, identifier: CW68011
2025-12-05 17:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317a4c86-81c9-5eaf-9880-223c6b644b2d with identifier: YC19124
2025-12-05 17:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317a4c86-81c9-5eaf-9880-223c6b644b2d with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 317a4c86-81c9-5eaf-9880-223c6b644b2d with scrape type 2
2025-12-05 17:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 317a4c86-81c9-5eaf-9880-223c6b644b2d, identifier: YC19124
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg not downloaded yet
2025-12-05 17:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a7eda1f-b91c-5052-82ef-2d3f5332a563 with identifier: CW68011
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a7eda1f-b91c-5052-82ef-2d3f5332a563 with identifier: CW68011
2025-12-05 17:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a7eda1f-b91c-5052-82ef-2d3f5332a563 with identifier: CW68011 to the API
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW68011>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:18:17Z',
'fuel_type': 'electro',
'id': '5a7eda1f-b91c-5052-82ef-2d3f5332a563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW68011',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 16637,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW68011%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [auto1.fr] INFO: Saving data for CW68011: {'auction_closing_time': 1765037897.0, 'created_time': 1764781867.297396, 'last_price_update_time': 1764954247.630075}
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CW68011') HTTP/1.1" 204 0
2025-12-05 17:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 317a4c86-81c9-5eaf-9880-223c6b644b2d with identifier: YC19124
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 317a4c86-81c9-5eaf-9880-223c6b644b2d with identifier: YC19124
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 22562, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc19124', 'expiration_date': '2025-12-06t16:58:27z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '317a4c86-81c9-5eaf-9880-223c6b644b2d', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 22562}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:58:27z',
'fuel_type': 'petrol',
'id': '317a4c86-81c9-5eaf-9880-223c6b644b2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc19124',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 22562,
'odometer_in_km': 22562,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 317a4c86-81c9-5eaf-9880-223c6b644b2d spider: auto1.fr
2025-12-05 17:04:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 317a4c86-81c9-5eaf-9880-223c6b644b2d due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 22562, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc19124', 'expiration_date': '2025-12-06t16:58:27z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '317a4c86-81c9-5eaf-9880-223c6b644b2d', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 22562}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:58:27z',
'fuel_type': 'petrol',
'id': '317a4c86-81c9-5eaf-9880-223c6b644b2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc19124',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 22562,
'odometer_in_km': 22562,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:58:27Z',
'fuel_type': 'petrol',
'id': '317a4c86-81c9-5eaf-9880-223c6b644b2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC19124',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 22562,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC19124%27 HTTP/1.1" 200 None
2025-12-05 17:04:07 [auto1.fr] INFO: Saving data for YC19124: {'auction_closing_time': 1765040307.0, 'created_time': 1764782012.059569, 'last_price_update_time': 1764954247.863325}
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YC19124') HTTP/1.1" 204 0
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e07d0>
2025-12-05 17:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_845f3e346aa5fe9ead0e6c67b382a5e1.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_845f3e346aa5fe9ead0e6c67b382a5e1.jpg saved to cache
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_2c397fbec4dd4216f6907c444581c345.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_f3c89a10fa644ab00de2ac5d01834165.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:08 [scrapy.extensions.logstats] INFO: Crawled 477 pages (at 107 pages/min), scraped 110 items (at 30 items/min)
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_0d96bafecabf1e851d5457e51ad4f556.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg not downloaded yet
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD63304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY74996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE20714> (referer: https://www.auto1.com/v1/car-details-view/BE20714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP06562> (referer: https://www.auto1.com/v1/car-details-view/ZP06562/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837438e2-23ae-53ee-944a-0fac07512a0b with identifier: SH41578
2025-12-05 17:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837438e2-23ae-53ee-944a-0fac07512a0b with scrape type 2
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 837438e2-23ae-53ee-944a-0fac07512a0b with scrape type 2
2025-12-05 17:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 837438e2-23ae-53ee-944a-0fac07512a0b, identifier: SH41578
2025-12-05 17:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 837438e2-23ae-53ee-944a-0fac07512a0b with identifier: SH41578
2025-12-05 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 837438e2-23ae-53ee-944a-0fac07512a0b with identifier: SH41578
2025-12-05 17:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 837438e2-23ae-53ee-944a-0fac07512a0b with identifier: SH41578 to the API
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SH41578>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 158,
'expiration_date': '2025-12-06T16:08:12Z',
'fuel_type': 'petrol',
'id': '837438e2-23ae-53ee-944a-0fac07512a0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH41578',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Renault',
'model': 'Arkana',
'odometer': 45483,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.3 TCe R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2021}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH41578%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [auto1.fr] INFO: Saving data for SH41578: {'auction_closing_time': 1765037292.0, 'created_time': 1762337317.992316, 'last_price_update_time': 1764954248.553514}
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SH41578') HTTP/1.1" 204 0
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_907f31204019d9acf5f503e4cf3e9438.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg not downloaded yet
2025-12-05 17:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_50faab373571ea1367220745180506db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg not downloaded yet
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e4b610>
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_2c397fbec4dd4216f6907c444581c345.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_2c397fbec4dd4216f6907c444581c345.jpg saved to cache
2025-12-05 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5afb010>
2025-12-05 17:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fea%252F02eaa9abcf74916f84b9e62ce640569f%252Fpa%252FVB77810_f3c89a10fa644ab00de2ac5d01834165.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_f3c89a10fa644ab00de2ac5d01834165.jpg saved to cache
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ff8dd928-aad1-51fa-860e-5769eb526675
2025-12-05 17:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff8dd928-aad1-51fa-860e-5769eb526675, skipping ID generation
2025-12-05 17:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8dd928-aad1-51fa-860e-5769eb526675 with scrape type 1
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ff8dd928-aad1-51fa-860e-5769eb526675 from tracking dictionaries
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff8dd928-aad1-51fa-860e-5769eb526675 sending to next pipeline
2025-12-05 17:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff8dd928-aad1-51fa-860e-5769eb526675, identifier: VB77810
2025-12-05 17:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b76bcf-ea40-52e0-bb66-e710e6d09015 with identifier: BE20714
2025-12-05 17:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b76bcf-ea40-52e0-bb66-e710e6d09015 with scrape type 2
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95b76bcf-ea40-52e0-bb66-e710e6d09015 with scrape type 2
2025-12-05 17:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 95b76bcf-ea40-52e0-bb66-e710e6d09015, identifier: BE20714
2025-12-05 17:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 362ec1c2-5bee-50f7-9705-a92875b2f434 with identifier: ZP06562
2025-12-05 17:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362ec1c2-5bee-50f7-9705-a92875b2f434 with scrape type 2
2025-12-05 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 362ec1c2-5bee-50f7-9705-a92875b2f434 with scrape type 2
2025-12-05 17:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 362ec1c2-5bee-50f7-9705-a92875b2f434, identifier: ZP06562
2025-12-05 17:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff8dd928-aad1-51fa-860e-5769eb526675 with identifier: VB77810
2025-12-05 17:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff8dd928-aad1-51fa-860e-5769eb526675 with identifier: VB77810
2025-12-05 17:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131302 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
131302
2025-12-05 17:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ff8dd928-aad1-51fa-860e-5769eb526675 spider: auto1.fr
2025-12-05 17:04:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ff8dd928-aad1-51fa-860e-5769eb526675 due to rule: high_mileage_for_make.json, error: 131302 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
131302
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:03:13Z',
'fuel_type': 'diesel',
'id': 'ff8dd928-aad1-51fa-860e-5769eb526675',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB77810',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Megane',
'odometer': 131302,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_012711f5fb13261106b178c16ffa660d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c960995721421e9ce28372383a3b5b4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5938c2d162a3c7a3b8b3932bae3685bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_22fd49243170d25aed5bdf5dbf4607d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cc2d7fb7bb355bdf399665affbd65ddf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_cd68f6577898025146231e3c75c471e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fd4d46e2ccf631661db7613f704c939c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_3562d31204ac31cf880c13204c264fc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c6cf1898cd6d99a27fd5b047504a0ce3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5a9113c489934c8027177ed5c9d47094.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_31bdfa6f27f0fcc29b1d72c918b4514e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_fbb7d74c464561096903278c8a1705e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_5dde0bf62a0fefb2cb5cfad85b49bef5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_56576135561d5d9aa21d8a94563421a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_c271f3ebba55a1460524ea8de7c0ab96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_e4dcf75d74dcb72078583fadb04b9a62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_76336bd499e70260a3ecb2891d418a43.jpg',
'Width': 505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20439,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_845f3e346aa5fe9ead0e6c67b382a5e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22587,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_2c397fbec4dd4216f6907c444581c345.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8dd928-aad1-51fa-860e-5769eb526675/ff8dd928-aad1-51fa-860e-5769eb526675_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/ea/02eaa9abcf74916f84b9e62ce640569f/pa/VB77810_f3c89a10fa644ab00de2ac5d01834165.jpg',
'Width': 574}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 Blue dCi Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2019}
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB77810%27 HTTP/1.1" 200 None
2025-12-05 17:04:09 [auto1.fr] INFO: Saving data for VB77810: {'created_time': 1764954249.727118, 'last_price_update_time': 1764954249.727128, 'auction_closing_time': 1765036993.0}
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VB77810') HTTP/1.1" 204 0
2025-12-05 17:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 95b76bcf-ea40-52e0-bb66-e710e6d09015 with identifier: BE20714
2025-12-05 17:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 95b76bcf-ea40-52e0-bb66-e710e6d09015 with identifier: BE20714
2025-12-05 17:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 95b76bcf-ea40-52e0-bb66-e710e6d09015 with identifier: BE20714 to the API
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE20714>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:56:54Z',
'fuel_type': 'electro',
'id': '95b76bcf-ea40-52e0-bb66-e710e6d09015',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE20714',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 9631,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE20714%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [auto1.fr] INFO: Saving data for BE20714: {'auction_closing_time': 1765040214.0, 'created_time': 1764781869.751237, 'last_price_update_time': 1764954250.047896}
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE20714') HTTP/1.1" 204 0
2025-12-05 17:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 362ec1c2-5bee-50f7-9705-a92875b2f434 with identifier: ZP06562
2025-12-05 17:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 362ec1c2-5bee-50f7-9705-a92875b2f434 with identifier: ZP06562
2025-12-05 17:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 362ec1c2-5bee-50f7-9705-a92875b2f434 with identifier: ZP06562 to the API
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP06562>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:19:31Z',
'fuel_type': 'diesel',
'id': '362ec1c2-5bee-50f7-9705-a92875b2f434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP06562',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Ford',
'model': 'Kuga',
'odometer': 120543,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 TDCi EcoBlue Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2020}
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP06562%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [auto1.fr] INFO: Saving data for ZP06562: {'auction_closing_time': 1765037971.0, 'created_time': 1763028259.597411, 'last_price_update_time': 1764954250.387293}
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP06562') HTTP/1.1" 204 0
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_241a6ae5ed2b1f6637297676c86032e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg not downloaded yet
2025-12-05 17:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb02d0>
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_08d806cc408a0b58031842ea190c6481.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg saved to cache
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_2e355c86d66301f9e391c36a00352bfd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg not downloaded yet
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c2510>
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_df85c4f0144fa195d6d0e514dea1a219.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg saved to cache
2025-12-05 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD07581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a97bd0>
2025-12-05 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_62925c549c4e093aee808b8c51cfaa1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg saved to cache
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW60092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK09971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5964a10>
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_907f31204019d9acf5f503e4cf3e9438.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg saved to cache
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e092d0>
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg saved to cache
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP82552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA38303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD02456/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY74996> (referer: https://www.auto1.com/v1/car-details-view/AY74996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d20410>
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_2e355c86d66301f9e391c36a00352bfd.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg saved to cache
2025-12-05 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582d510>
2025-12-05 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_241a6ae5ed2b1f6637297676c86032e6.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg saved to cache
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5829810>
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_50faab373571ea1367220745180506db.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg saved to cache
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ebb1ee-c966-51b4-aad8-d58fda19e111 with identifier: AY74996
2025-12-05 17:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ebb1ee-c966-51b4-aad8-d58fda19e111 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ebb1ee-c966-51b4-aad8-d58fda19e111 with scrape type 2
2025-12-05 17:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1ebb1ee-c966-51b4-aad8-d58fda19e111, identifier: AY74996
2025-12-05 17:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1ebb1ee-c966-51b4-aad8-d58fda19e111 with identifier: AY74996
2025-12-05 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1ebb1ee-c966-51b4-aad8-d58fda19e111 with identifier: AY74996
2025-12-05 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 18731, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay74996', 'expiration_date': '2025-12-06t16:03:17z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b1ebb1ee-c966-51b4-aad8-d58fda19e111', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 18731}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:03:17z',
'fuel_type': 'petrol',
'id': 'b1ebb1ee-c966-51b4-aad8-d58fda19e111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay74996',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 18731,
'odometer_in_km': 18731,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: b1ebb1ee-c966-51b4-aad8-d58fda19e111 spider: auto1.fr
2025-12-05 17:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b1ebb1ee-c966-51b4-aad8-d58fda19e111 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 18731, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay74996', 'expiration_date': '2025-12-06t16:03:17z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b1ebb1ee-c966-51b4-aad8-d58fda19e111', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 18731}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:03:17z',
'fuel_type': 'petrol',
'id': 'b1ebb1ee-c966-51b4-aad8-d58fda19e111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay74996',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 18731,
'odometer_in_km': 18731,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:03:17Z',
'fuel_type': 'petrol',
'id': 'b1ebb1ee-c966-51b4-aad8-d58fda19e111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY74996',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 18731,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY74996%27 HTTP/1.1" 200 None
2025-12-05 17:04:12 [auto1.fr] INFO: Saving data for AY74996: {'auction_closing_time': 1765036997.0, 'created_time': 1764782014.800181, 'last_price_update_time': 1764954252.750624}
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY74996') HTTP/1.1" 204 0
2025-12-05 17:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ26532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1e6d0>
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_0d96bafecabf1e851d5457e51ad4f556.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg saved to cache
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR67880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB63635> (referer: https://www.auto1.com/v1/car-details-view/NB63635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD63304> (referer: https://www.auto1.com/v1/car-details-view/FD63304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f125219-d26e-5b23-a353-68fe37481030 with identifier: NB63635
2025-12-05 17:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f125219-d26e-5b23-a353-68fe37481030 with scrape type 2
2025-12-05 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f125219-d26e-5b23-a353-68fe37481030 with scrape type 2
2025-12-05 17:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f125219-d26e-5b23-a353-68fe37481030, identifier: NB63635
2025-12-05 17:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f125219-d26e-5b23-a353-68fe37481030 with identifier: NB63635
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2025-12-05 17:04:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f125219-d26e-5b23-a353-68fe37481030 with identifier: NB63635
2025-12-05 17:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f125219-d26e-5b23-a353-68fe37481030 with identifier: NB63635 to the API
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB63635>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:47:36Z',
'fuel_type': 'electro',
'id': '9f125219-d26e-5b23-a353-68fe37481030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB63635',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 10680,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB63635%27 HTTP/1.1" 200 None
2025-12-05 17:04:13 [auto1.fr] INFO: Saving data for NB63635: {'auction_closing_time': 1765039656.0, 'created_time': 1764781929.770219, 'last_price_update_time': 1764954253.899154}
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NB63635') HTTP/1.1" 204 0
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD95675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX38433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU72339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD07581> (referer: https://www.auto1.com/v1/car-details-view/GD07581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58469d0>
2025-12-05 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg saved to cache
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eefae61-b9e5-5f22-b458-f6a610a93bae with identifier: FD63304
2025-12-05 17:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eefae61-b9e5-5f22-b458-f6a610a93bae with scrape type 1
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_00a277774b88077953e8a3392b739f7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_00a277774b88077953e8a3392b739f7f.jpg not downloaded yet
2025-12-05 17:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5919050>
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_8b12cf4e0e213b229467f717fcd62377.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg saved to cache
2025-12-05 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57e5910>
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_756b5a8ef789a8356713ed967424ca5b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5964fd0>
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591b590>
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg saved to cache
2025-12-05 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f3490>
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F3c%252F343c52b2a665217fba5ca0ac3ac11400%252Fpa%252FYL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg saved to cache
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bffa652a-21d9-52c5-a310-fc5154e97262
2025-12-05 17:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bffa652a-21d9-52c5-a310-fc5154e97262, skipping ID generation
2025-12-05 17:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bffa652a-21d9-52c5-a310-fc5154e97262 with scrape type 1
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bffa652a-21d9-52c5-a310-fc5154e97262 from tracking dictionaries
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bffa652a-21d9-52c5-a310-fc5154e97262 sending to next pipeline
2025-12-05 17:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bffa652a-21d9-52c5-a310-fc5154e97262, identifier: YL29400
2025-12-05 17:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bffa652a-21d9-52c5-a310-fc5154e97262 with identifier: YL29400
2025-12-05 17:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bffa652a-21d9-52c5-a310-fc5154e97262 with identifier: YL29400
2025-12-05 17:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 10353, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl29400', 'expiration_date': '2025-12-06t16:24:30z', 'origin_country_code': 'fr', 'trim': 'grand chic', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, biarritz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': 'bffa652a-21d9-52c5-a310-fc5154e97262', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3362221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80984}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3196399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3104261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3113065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3150236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52742}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3344548}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57933}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57762}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 35684}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80207}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68113}], 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 10353}
Failed validating None in schema:
False
On instance:
{'age_in_months': 50,
'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:24:30z',
'fuel_type': 'petrol',
'id': 'bffa652a-21d9-52c5-a310-fc5154e97262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl29400',
'listing': 'auction',
'location': 'fr, biarritz',
'make': 'ds automobiles',
'make_model': 'ds automobiles ds3 crossback',
'model': 'ds3 crossback',
'odometer': 10353,
'odometer_in_km': 10353,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3362221,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3196399,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3104261,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3113065,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150236,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3344548,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-22',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic',
'transmission': 'automatic',
'trim': 'grand chic',
'year': 2021}
2025-12-05 17:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: bffa652a-21d9-52c5-a310-fc5154e97262 spider: auto1.fr
2025-12-05 17:04:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bffa652a-21d9-52c5-a310-fc5154e97262 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 10353, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl29400', 'expiration_date': '2025-12-06t16:24:30z', 'origin_country_code': 'fr', 'trim': 'grand chic', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, biarritz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': 'bffa652a-21d9-52c5-a310-fc5154e97262', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3362221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80984}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3196399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3104261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3113065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3150236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52742}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3344548}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57933}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57762}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 35684}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80207}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68113}], 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 10353}
Failed validating None in schema:
False
On instance:
{'age_in_months': 50,
'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:24:30z',
'fuel_type': 'petrol',
'id': 'bffa652a-21d9-52c5-a310-fc5154e97262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl29400',
'listing': 'auction',
'location': 'fr, biarritz',
'make': 'ds automobiles',
'make_model': 'ds automobiles ds3 crossback',
'model': 'ds3 crossback',
'odometer': 10353,
'odometer_in_km': 10353,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3362221,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3196399,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3104261,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3113065,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150236,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3344548,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-22',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic',
'transmission': 'automatic',
'trim': 'grand chic',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:24:30Z',
'fuel_type': 'petrol',
'id': 'bffa652a-21d9-52c5-a310-fc5154e97262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL29400',
'listing': 'auction',
'location': 'FR, Biarritz',
'make': 'DS Automobiles',
'model': 'DS3 Crossback',
'odometer': 10353,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3362221,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9cf70a3e0dcc8859285986bea1e10c7b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_f3c8ff5be3eeacd8e6553bc57ef0a10d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3196399,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_8b12cf4e0e213b229467f717fcd62377.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3104261,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_756b5a8ef789a8356713ed967424ca5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3113065,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_1a2a8b2a04dd8e7055d95e533a845c2e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150236,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_c74597f6cd163ab6469a7da5b3d8631c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_08d806cc408a0b58031842ea190c6481.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3344548,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_dc5d58f29d999f0d5ace71d9e5b8b6ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_62925c549c4e093aee808b8c51cfaa1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_df85c4f0144fa195d6d0e514dea1a219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_9f87f87a9dbf74ed8aab3433d1eb9c48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_0d96bafecabf1e851d5457e51ad4f556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_907f31204019d9acf5f503e4cf3e9438.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_50faab373571ea1367220745180506db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_241a6ae5ed2b1f6637297676c86032e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa652a-21d9-52c5-a310-fc5154e97262/bffa652a-21d9-52c5-a310-fc5154e97262_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/3c/343c52b2a665217fba5ca0ac3ac11400/pa/YL29400_2e355c86d66301f9e391c36a00352bfd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Grand Chic',
'transmission': 'automatic',
'trim': 'Grand Chic',
'year': 2021}
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL29400%27 HTTP/1.1" 200 None
2025-12-05 17:04:16 [auto1.fr] INFO: Saving data for YL29400: {'created_time': 1764954256.335242, 'last_price_update_time': 1764954256.335251, 'auction_closing_time': 1765038270.0}
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL29400') HTTP/1.1" 204 0
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_4d0ee5cdf1b5573687f8bf7879613af0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0ee5cdf1b5573687f8bf7879613af0.jpg not downloaded yet
2025-12-05 17:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD43033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33292ce6-ed3d-5219-aa99-9cae62660a2b with identifier: GD07581
2025-12-05 17:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33292ce6-ed3d-5219-aa99-9cae62660a2b with scrape type 2
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33292ce6-ed3d-5219-aa99-9cae62660a2b with scrape type 2
2025-12-05 17:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 33292ce6-ed3d-5219-aa99-9cae62660a2b, identifier: GD07581
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_650cab869d7fd5d8ac70d696ff6819d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_650cab869d7fd5d8ac70d696ff6819d4.jpg not downloaded yet
2025-12-05 17:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 33292ce6-ed3d-5219-aa99-9cae62660a2b with identifier: GD07581
2025-12-05 17:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 33292ce6-ed3d-5219-aa99-9cae62660a2b with identifier: GD07581
2025-12-05 17:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 33292ce6-ed3d-5219-aa99-9cae62660a2b with identifier: GD07581 to the API
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD07581>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:46:22Z',
'fuel_type': 'petrol',
'id': '33292ce6-ed3d-5219-aa99-9cae62660a2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD07581',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 9340,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-28',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD07581%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [auto1.fr] INFO: Saving data for GD07581: {'auction_closing_time': 1765039582.0, 'created_time': 1764782078.480726, 'last_price_update_time': 1764954257.062175}
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD07581') HTTP/1.1" 204 0
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_3487aea8be8ba7bedc5cd5d398d9025c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_3487aea8be8ba7bedc5cd5d398d9025c.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_918395d3a4da1b27334e28d025da556b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_918395d3a4da1b27334e28d025da556b.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_79bed49c7474d47e9d5f6e44f6d5c494.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_79bed49c7474d47e9d5f6e44f6d5c494.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_1b8bad5257b4881cf619ae5b9c535f58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_1b8bad5257b4881cf619ae5b9c535f58.jpg not downloaded yet
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_00a277774b88077953e8a3392b739f7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_bd99c1e7ea9da5b1de248b16d624cb0c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_bd99c1e7ea9da5b1de248b16d624cb0c.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_8af6f2df811f7d17ba29d529ef1f0536.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_8af6f2df811f7d17ba29d529ef1f0536.jpg not downloaded yet
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK09971> (referer: https://www.auto1.com/v1/car-details-view/TK09971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_a8c00a480f53ac3516fbbdb69ffeee9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8c00a480f53ac3516fbbdb69ffeee9c.jpg not downloaded yet
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_815e87f9d117071acee4ae1ea9722a55.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_815e87f9d117071acee4ae1ea9722a55.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_eb81b6b4aeb6981ca439e8cd7542f5a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_eb81b6b4aeb6981ca439e8cd7542f5a8.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_b66cda1c96f37d6bebabf1d3bc4369a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_b66cda1c96f37d6bebabf1d3bc4369a6.jpg not downloaded yet
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD02456> (referer: https://www.auto1.com/v1/car-details-view/YD02456/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0ee5cdf1b5573687f8bf7879613af0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_4d0dde402a5f3bfd282a3f90582cad01.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0dde402a5f3bfd282a3f90582cad01.jpg not downloaded yet
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575c750>
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_00a277774b88077953e8a3392b739f7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_00a277774b88077953e8a3392b739f7f.jpg saved to cache
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_9e7620c133f1874a99c6c988840507f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_9e7620c133f1874a99c6c988840507f7.jpg not downloaded yet
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_a8614e4d1ec86f8a0faf61767ee6986e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8614e4d1ec86f8a0faf61767ee6986e.jpg not downloaded yet
2025-12-05 17:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7dd1b7-227d-5679-b3ef-8e6266a9f85c with identifier: TK09971
2025-12-05 17:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7dd1b7-227d-5679-b3ef-8e6266a9f85c with scrape type 2
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7dd1b7-227d-5679-b3ef-8e6266a9f85c with scrape type 2
2025-12-05 17:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd7dd1b7-227d-5679-b3ef-8e6266a9f85c, identifier: TK09971
2025-12-05 17:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f07922-c2d4-5a54-a949-40b69bfb462b with identifier: YD02456
2025-12-05 17:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f07922-c2d4-5a54-a949-40b69bfb462b with scrape type 2
2025-12-05 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4f07922-c2d4-5a54-a949-40b69bfb462b with scrape type 2
2025-12-05 17:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4f07922-c2d4-5a54-a949-40b69bfb462b, identifier: YD02456
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a81c50>
2025-12-05 17:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_4d0ee5cdf1b5573687f8bf7879613af0.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0ee5cdf1b5573687f8bf7879613af0.jpg saved to cache
2025-12-05 17:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd7dd1b7-227d-5679-b3ef-8e6266a9f85c with identifier: TK09971
2025-12-05 17:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd7dd1b7-227d-5679-b3ef-8e6266a9f85c with identifier: TK09971
2025-12-05 17:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech max', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 16918, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tk09971', 'expiration_date': '2025-12-06t16:33:26z', 'origin_country_code': 'fr', 'trim': 'max', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'fd7dd1b7-227d-5679-b3ef-8e6266a9f85c', 'current_year_diff': 2, 'age_in_months': 25, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 16918}
Failed validating None in schema:
False
On instance:
{'age_in_months': 25,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:33:26z',
'fuel_type': 'petrol',
'id': 'fd7dd1b7-227d-5679-b3ef-8e6266a9f85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tk09971',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 16918,
'odometer_in_km': 16918,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-24',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech max',
'transmission': 'manual',
'trim': 'max',
'year': 2023}
2025-12-05 17:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: fd7dd1b7-227d-5679-b3ef-8e6266a9f85c spider: auto1.fr
2025-12-05 17:04:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fd7dd1b7-227d-5679-b3ef-8e6266a9f85c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech max', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 16918, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tk09971', 'expiration_date': '2025-12-06t16:33:26z', 'origin_country_code': 'fr', 'trim': 'max', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'fd7dd1b7-227d-5679-b3ef-8e6266a9f85c', 'current_year_diff': 2, 'age_in_months': 25, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 16918}
Failed validating None in schema:
False
On instance:
{'age_in_months': 25,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:33:26z',
'fuel_type': 'petrol',
'id': 'fd7dd1b7-227d-5679-b3ef-8e6266a9f85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tk09971',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 16918,
'odometer_in_km': 16918,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-24',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech max',
'transmission': 'manual',
'trim': 'max',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:33:26Z',
'fuel_type': 'petrol',
'id': 'fd7dd1b7-227d-5679-b3ef-8e6266a9f85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK09971',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 16918,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Max',
'transmission': 'manual',
'trim': 'Max',
'year': 2023}
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK09971%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.fr] INFO: Saving data for TK09971: {'auction_closing_time': 1765038806.0, 'created_time': 1764782380.882733, 'last_price_update_time': 1764954258.248539}
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK09971') HTTP/1.1" 204 0
2025-12-05 17:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4f07922-c2d4-5a54-a949-40b69bfb462b with identifier: YD02456
2025-12-05 17:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4f07922-c2d4-5a54-a949-40b69bfb462b with identifier: YD02456
2025-12-05 17:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f4f07922-c2d4-5a54-a949-40b69bfb462b with identifier: YD02456 to the API
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD02456>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:50:09Z',
'fuel_type': 'electro',
'id': 'f4f07922-c2d4-5a54-a949-40b69bfb462b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD02456',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 22604,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-24',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD02456%27 HTTP/1.1" 200 None
2025-12-05 17:04:18 [auto1.fr] INFO: Saving data for YD02456: {'auction_closing_time': 1765039809.0, 'created_time': 1764781884.224661, 'last_price_update_time': 1764954258.776108}
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YD02456') HTTP/1.1" 204 0
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_b66cda1c96f37d6bebabf1d3bc4369a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA38303> (referer: https://www.auto1.com/v1/car-details-view/SA38303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR67880> (referer: https://www.auto1.com/v1/car-details-view/YR67880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP90188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP82552> (referer: https://www.auto1.com/v1/car-details-view/FP82552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ26532> (referer: https://www.auto1.com/v1/car-details-view/CJ26532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW60092> (referer: https://www.auto1.com/v1/car-details-view/FW60092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_1b8bad5257b4881cf619ae5b9c535f58.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_8af6f2df811f7d17ba29d529ef1f0536.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_eb81b6b4aeb6981ca439e8cd7542f5a8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_815e87f9d117071acee4ae1ea9722a55.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0dde402a5f3bfd282a3f90582cad01.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5878850>
2025-12-05 17:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_b66cda1c96f37d6bebabf1d3bc4369a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_b66cda1c96f37d6bebabf1d3bc4369a6.jpg saved to cache
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8614e4d1ec86f8a0faf61767ee6986e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_9e7620c133f1874a99c6c988840507f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d with identifier: SA38303
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d, identifier: SA38303
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e11f451a-a6b4-5a79-b921-9ca0f2c78041 with identifier: YR67880
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e11f451a-a6b4-5a79-b921-9ca0f2c78041 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e11f451a-a6b4-5a79-b921-9ca0f2c78041 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e11f451a-a6b4-5a79-b921-9ca0f2c78041, identifier: YR67880
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 with identifier: FP82552
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1fe6b40d-4a39-5cb1-8cd8-c03640a59446, identifier: FP82552
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f874f838-09e9-51da-ba9d-11e3475d050e with identifier: CJ26532
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f874f838-09e9-51da-ba9d-11e3475d050e with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f874f838-09e9-51da-ba9d-11e3475d050e with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f874f838-09e9-51da-ba9d-11e3475d050e, identifier: CJ26532
2025-12-05 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65ab68d-cf05-54db-a014-87d0420655ad with identifier: FW60092
2025-12-05 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65ab68d-cf05-54db-a014-87d0420655ad with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e65ab68d-cf05-54db-a014-87d0420655ad with scrape type 2
2025-12-05 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e65ab68d-cf05-54db-a014-87d0420655ad, identifier: FW60092
2025-12-05 17:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef4950>
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_1b8bad5257b4881cf619ae5b9c535f58.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_1b8bad5257b4881cf619ae5b9c535f58.jpg saved to cache
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59909d0>
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_8af6f2df811f7d17ba29d529ef1f0536.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_8af6f2df811f7d17ba29d529ef1f0536.jpg saved to cache
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f1650>
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_eb81b6b4aeb6981ca439e8cd7542f5a8.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_eb81b6b4aeb6981ca439e8cd7542f5a8.jpg saved to cache
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d60750>
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_815e87f9d117071acee4ae1ea9722a55.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_815e87f9d117071acee4ae1ea9722a55.jpg saved to cache
2025-12-05 17:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f39d0>
2025-12-05 17:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_4d0dde402a5f3bfd282a3f90582cad01.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0dde402a5f3bfd282a3f90582cad01.jpg saved to cache
2025-12-05 17:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d with identifier: SA38303
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d with identifier: SA38303
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'brown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 10941, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sa38303', 'expiration_date': '2025-12-06t16:16:06z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '5ecd4cd4-1c6f-5344-9173-d7d07d0a614d', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 10941}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'brown',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:16:06z',
'fuel_type': 'petrol',
'id': '5ecd4cd4-1c6f-5344-9173-d7d07d0a614d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sa38303',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 10941,
'odometer_in_km': 10941,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-26',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d spider: auto1.fr
2025-12-05 17:04:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5ecd4cd4-1c6f-5344-9173-d7d07d0a614d due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'brown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 10941, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sa38303', 'expiration_date': '2025-12-06t16:16:06z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '5ecd4cd4-1c6f-5344-9173-d7d07d0a614d', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 10941}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'brown',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:16:06z',
'fuel_type': 'petrol',
'id': '5ecd4cd4-1c6f-5344-9173-d7d07d0a614d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sa38303',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 10941,
'odometer_in_km': 10941,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-26',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:16:06Z',
'fuel_type': 'petrol',
'id': '5ecd4cd4-1c6f-5344-9173-d7d07d0a614d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA38303',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 10941,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA38303%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.fr] INFO: Saving data for SA38303: {'auction_closing_time': 1765037766.0, 'created_time': 1764781713.962305, 'last_price_update_time': 1764954261.411116}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SA38303') HTTP/1.1" 204 0
2025-12-05 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e11f451a-a6b4-5a79-b921-9ca0f2c78041 with identifier: YR67880
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e11f451a-a6b4-5a79-b921-9ca0f2c78041 with identifier: YR67880
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e11f451a-a6b4-5a79-b921-9ca0f2c78041 spider: auto1.fr
2025-12-05 17:04:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e11f451a-a6b4-5a79-b921-9ca0f2c78041 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2025-12-06T16:19:48Z',
'fuel_type': 'petrol',
'id': 'e11f451a-a6b4-5a79-b921-9ca0f2c78041',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR67880',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 79046,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-02',
'seats_number': 7,
'seller_name': None,
'title': 'Dacia Lodgy 1.6 SCe Silver Line',
'transmission': 'manual',
'trim': 'Silver Line',
'year': 2019}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR67880%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.fr] INFO: Saving data for YR67880: {'auction_closing_time': 1765037988.0, 'created_time': 1763485553.339622, 'last_price_update_time': 1764954261.632358}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR67880') HTTP/1.1" 204 0
2025-12-05 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 with identifier: FP82552
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 with identifier: FP82552
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 57114, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp82552', 'expiration_date': '2025-12-06t16:23:47z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '1fe6b40d-4a39-5cb1-8cd8-c03640a59446', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 57114}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:47z',
'fuel_type': 'petrol',
'id': '1fe6b40d-4a39-5cb1-8cd8-c03640a59446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp82552',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 57114,
'odometer_in_km': 57114,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 spider: auto1.fr
2025-12-05 17:04:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1fe6b40d-4a39-5cb1-8cd8-c03640a59446 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 57114, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp82552', 'expiration_date': '2025-12-06t16:23:47z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '1fe6b40d-4a39-5cb1-8cd8-c03640a59446', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 57114}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:47z',
'fuel_type': 'petrol',
'id': '1fe6b40d-4a39-5cb1-8cd8-c03640a59446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp82552',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 57114,
'odometer_in_km': 57114,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:23:47Z',
'fuel_type': 'petrol',
'id': '1fe6b40d-4a39-5cb1-8cd8-c03640a59446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP82552',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 57114,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP82552%27 HTTP/1.1" 200 None
2025-12-05 17:04:21 [auto1.fr] INFO: Saving data for FP82552: {'auction_closing_time': 1765038227.0, 'created_time': 1764781964.730757, 'last_price_update_time': 1764954261.858904}
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP82552') HTTP/1.1" 204 0
2025-12-05 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f874f838-09e9-51da-ba9d-11e3475d050e with identifier: CJ26532
2025-12-05 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f874f838-09e9-51da-ba9d-11e3475d050e with identifier: CJ26532
2025-12-05 17:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f874f838-09e9-51da-ba9d-11e3475d050e with identifier: CJ26532 to the API
2025-12-05 17:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CJ26532>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:47:25Z',
'fuel_type': 'electro',
'id': 'f874f838-09e9-51da-ba9d-11e3475d050e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ26532',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 5361,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ26532%27 HTTP/1.1" 200 None
2025-12-05 17:04:22 [auto1.fr] INFO: Saving data for CJ26532: {'auction_closing_time': 1765039645.0, 'created_time': 1764781885.019479, 'last_price_update_time': 1764954262.189808}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ26532') HTTP/1.1" 204 0
2025-12-05 17:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e65ab68d-cf05-54db-a014-87d0420655ad with identifier: FW60092
2025-12-05 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e65ab68d-cf05-54db-a014-87d0420655ad with identifier: FW60092
2025-12-05 17:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e65ab68d-cf05-54db-a014-87d0420655ad with identifier: FW60092 to the API
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW60092>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:38:44Z',
'fuel_type': 'electro',
'id': 'e65ab68d-cf05-54db-a014-87d0420655ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW60092',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 21912,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW60092%27 HTTP/1.1" 200 None
2025-12-05 17:04:22 [auto1.fr] INFO: Saving data for FW60092: {'auction_closing_time': 1765039124.0, 'created_time': 1764781870.126417, 'last_price_update_time': 1764954262.489552}
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW60092') HTTP/1.1" 204 0
2025-12-05 17:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF21079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE60105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d7f210>
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_a8614e4d1ec86f8a0faf61767ee6986e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8614e4d1ec86f8a0faf61767ee6986e.jpg saved to cache
2025-12-05 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7d950>
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_9e7620c133f1874a99c6c988840507f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_9e7620c133f1874a99c6c988840507f7.jpg saved to cache
2025-12-05 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR33594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8c00a480f53ac3516fbbdb69ffeee9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_918395d3a4da1b27334e28d025da556b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_bd99c1e7ea9da5b1de248b16d624cb0c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_79bed49c7474d47e9d5f6e44f6d5c494.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM03961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_650cab869d7fd5d8ac70d696ff6819d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57a8cd0>
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_a8c00a480f53ac3516fbbdb69ffeee9c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8c00a480f53ac3516fbbdb69ffeee9c.jpg saved to cache
2025-12-05 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_3487aea8be8ba7bedc5cd5d398d9025c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d6d850>
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_918395d3a4da1b27334e28d025da556b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_918395d3a4da1b27334e28d025da556b.jpg saved to cache
2025-12-05 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7c11fd0>
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_bd99c1e7ea9da5b1de248b16d624cb0c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_bd99c1e7ea9da5b1de248b16d624cb0c.jpg saved to cache
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e82fd0>
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_79bed49c7474d47e9d5f6e44f6d5c494.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_79bed49c7474d47e9d5f6e44f6d5c494.jpg saved to cache
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC31199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0d550>
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_650cab869d7fd5d8ac70d696ff6819d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_650cab869d7fd5d8ac70d696ff6819d4.jpg saved to cache
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD05888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c589b5d0>
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fb8%252Ff5b83c38cb22635c956c0450b846a6af%252Fpa%252FFD63304_3487aea8be8ba7bedc5cd5d398d9025c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_3487aea8be8ba7bedc5cd5d398d9025c.jpg saved to cache
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eefae61-b9e5-5f22-b458-f6a610a93bae
2025-12-05 17:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eefae61-b9e5-5f22-b458-f6a610a93bae, skipping ID generation
2025-12-05 17:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eefae61-b9e5-5f22-b458-f6a610a93bae with scrape type 1
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2eefae61-b9e5-5f22-b458-f6a610a93bae from tracking dictionaries
2025-12-05 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eefae61-b9e5-5f22-b458-f6a610a93bae sending to next pipeline
2025-12-05 17:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2eefae61-b9e5-5f22-b458-f6a610a93bae, identifier: FD63304
2025-12-05 17:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2eefae61-b9e5-5f22-b458-f6a610a93bae with identifier: FD63304
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2eefae61-b9e5-5f22-b458-f6a610a93bae with identifier: FD63304
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2eefae61-b9e5-5f22-b458-f6a610a93bae spider: auto1.fr
2025-12-05 17:04:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2eefae61-b9e5-5f22-b458-f6a610a93bae due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:12:45Z',
'fuel_type': 'diesel',
'id': '2eefae61-b9e5-5f22-b458-f6a610a93bae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD63304',
'listing': 'auction',
'location': 'FR, Châtillon',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 55213,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_00a277774b88077953e8a3392b739f7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0ee5cdf1b5573687f8bf7879613af0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_650cab869d7fd5d8ac70d696ff6819d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_3487aea8be8ba7bedc5cd5d398d9025c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2958923,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_918395d3a4da1b27334e28d025da556b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3051654,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_79bed49c7474d47e9d5f6e44f6d5c494.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3057539,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_1b8bad5257b4881cf619ae5b9c535f58.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3013754,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_bd99c1e7ea9da5b1de248b16d624cb0c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3059793,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_8af6f2df811f7d17ba29d529ef1f0536.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3020807,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8c00a480f53ac3516fbbdb69ffeee9c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_815e87f9d117071acee4ae1ea9722a55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3090057,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_eb81b6b4aeb6981ca439e8cd7542f5a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_b66cda1c96f37d6bebabf1d3bc4369a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_4d0dde402a5f3bfd282a3f90582cad01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_9e7620c133f1874a99c6c988840507f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eefae61-b9e5-5f22-b458-f6a610a93bae/2eefae61-b9e5-5f22-b458-f6a610a93bae_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/b8/f5b83c38cb22635c956c0450b846a6af/pa/FD63304_a8614e4d1ec86f8a0faf61767ee6986e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-24',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Express Extra Série Spéciale',
'transmission': 'manual',
'trim': 'Express Extra Série Spéciale',
'year': 2021}
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD63304%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [auto1.fr] INFO: Saving data for FD63304: {'created_time': 1764954265.249493, 'last_price_update_time': 1764954265.249503, 'auction_closing_time': 1765037565.0}
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FD63304') HTTP/1.1" 204 0
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX38433> (referer: https://www.auto1.com/v1/car-details-view/UX38433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD95675> (referer: https://www.auto1.com/v1/car-details-view/AD95675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU72339> (referer: https://www.auto1.com/v1/car-details-view/JU72339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP90188> (referer: https://www.auto1.com/v1/car-details-view/DP90188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD43033> (referer: https://www.auto1.com/v1/car-details-view/SD43033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ69035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c31e7f59-4c63-5e18-96f5-3180201a957a with identifier: UX38433
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c31e7f59-4c63-5e18-96f5-3180201a957a with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c31e7f59-4c63-5e18-96f5-3180201a957a with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c31e7f59-4c63-5e18-96f5-3180201a957a, identifier: UX38433
2025-12-05 17:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c31e7f59-4c63-5e18-96f5-3180201a957a with identifier: UX38433
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c31e7f59-4c63-5e18-96f5-3180201a957a with identifier: UX38433
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 13313, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux38433', 'expiration_date': '2025-12-06t16:30:26z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'c31e7f59-4c63-5e18-96f5-3180201a957a', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 13313}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:30:26z',
'fuel_type': 'petrol',
'id': 'c31e7f59-4c63-5e18-96f5-3180201a957a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux38433',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 13313,
'odometer_in_km': 13313,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-07',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2023}
2025-12-05 17:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c31e7f59-4c63-5e18-96f5-3180201a957a spider: auto1.fr
2025-12-05 17:04:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c31e7f59-4c63-5e18-96f5-3180201a957a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 13313, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux38433', 'expiration_date': '2025-12-06t16:30:26z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'c31e7f59-4c63-5e18-96f5-3180201a957a', 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 13313}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:30:26z',
'fuel_type': 'petrol',
'id': 'c31e7f59-4c63-5e18-96f5-3180201a957a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux38433',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 13313,
'odometer_in_km': 13313,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-07',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:30:26Z',
'fuel_type': 'petrol',
'id': 'c31e7f59-4c63-5e18-96f5-3180201a957a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX38433',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 13313,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech C-Series',
'transmission': 'manual',
'trim': 'C-Series',
'year': 2023}
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX38433%27 HTTP/1.1" 200 None
2025-12-05 17:04:25 [auto1.fr] INFO: Saving data for UX38433: {'auction_closing_time': 1765038626.0, 'created_time': 1764782330.881078, 'last_price_update_time': 1764954265.690065}
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UX38433') HTTP/1.1" 204 0
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f51dc744-9517-59b9-9862-ff90f72ed4a7 with identifier: AD95675
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f51dc744-9517-59b9-9862-ff90f72ed4a7 with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f51dc744-9517-59b9-9862-ff90f72ed4a7 with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f51dc744-9517-59b9-9862-ff90f72ed4a7, identifier: AD95675
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa7342af-43ad-51a4-be20-f0eba044a753 with identifier: JU72339
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa7342af-43ad-51a4-be20-f0eba044a753 with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa7342af-43ad-51a4-be20-f0eba044a753 with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa7342af-43ad-51a4-be20-f0eba044a753, identifier: JU72339
2025-12-05 17:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75fd18ae-35c8-5b70-85cd-cc58b51ca981 with identifier: DP90188
2025-12-05 17:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75fd18ae-35c8-5b70-85cd-cc58b51ca981 with scrape type 2
2025-12-05 17:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75fd18ae-35c8-5b70-85cd-cc58b51ca981 with scrape type 2
2025-12-05 17:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75fd18ae-35c8-5b70-85cd-cc58b51ca981, identifier: DP90188
2025-12-05 17:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5badaf-998b-5ff2-afec-9e2b2f5d16db with identifier: SD43033
2025-12-05 17:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5badaf-998b-5ff2-afec-9e2b2f5d16db with scrape type 2
2025-12-05 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5badaf-998b-5ff2-afec-9e2b2f5d16db with scrape type 2
2025-12-05 17:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf5badaf-998b-5ff2-afec-9e2b2f5d16db, identifier: SD43033
2025-12-05 17:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f51dc744-9517-59b9-9862-ff90f72ed4a7 with identifier: AD95675
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f51dc744-9517-59b9-9862-ff90f72ed4a7 with identifier: AD95675
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 25389, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ad95675', 'expiration_date': '2025-12-06t16:03:52z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'f51dc744-9517-59b9-9862-ff90f72ed4a7', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 25389}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:03:52z',
'fuel_type': 'petrol',
'id': 'f51dc744-9517-59b9-9862-ff90f72ed4a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ad95675',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 25389,
'odometer_in_km': 25389,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: f51dc744-9517-59b9-9862-ff90f72ed4a7 spider: auto1.fr
2025-12-05 17:04:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f51dc744-9517-59b9-9862-ff90f72ed4a7 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 25389, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ad95675', 'expiration_date': '2025-12-06t16:03:52z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'f51dc744-9517-59b9-9862-ff90f72ed4a7', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 25389}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:03:52z',
'fuel_type': 'petrol',
'id': 'f51dc744-9517-59b9-9862-ff90f72ed4a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ad95675',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 25389,
'odometer_in_km': 25389,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:03:52Z',
'fuel_type': 'petrol',
'id': 'f51dc744-9517-59b9-9862-ff90f72ed4a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD95675',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 25389,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD95675%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [auto1.fr] INFO: Saving data for AD95675: {'auction_closing_time': 1765037032.0, 'created_time': 1764781965.600786, 'last_price_update_time': 1764954266.335037}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AD95675') HTTP/1.1" 204 0
2025-12-05 17:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa7342af-43ad-51a4-be20-f0eba044a753 with identifier: JU72339
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa7342af-43ad-51a4-be20-f0eba044a753 with identifier: JU72339
2025-12-05 17:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aa7342af-43ad-51a4-be20-f0eba044a753 with identifier: JU72339 to the API
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU72339>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:36:11Z',
'fuel_type': 'electro',
'id': 'aa7342af-43ad-51a4-be20-f0eba044a753',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU72339',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 16816,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW Action',
'transmission': 'automatic',
'trim': 'Action',
'year': 2023}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU72339%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [auto1.fr] INFO: Saving data for JU72339: {'auction_closing_time': 1765038971.0, 'created_time': 1764782226.231872, 'last_price_update_time': 1764954266.651483}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU72339') HTTP/1.1" 204 0
2025-12-05 17:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75fd18ae-35c8-5b70-85cd-cc58b51ca981 with identifier: DP90188
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75fd18ae-35c8-5b70-85cd-cc58b51ca981 with identifier: DP90188
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 19792, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dp90188', 'expiration_date': '2025-12-06t16:57:19z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '75fd18ae-35c8-5b70-85cd-cc58b51ca981', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 19792}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:57:19z',
'fuel_type': 'petrol',
'id': '75fd18ae-35c8-5b70-85cd-cc58b51ca981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dp90188',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 19792,
'odometer_in_km': 19792,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-21',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 75fd18ae-35c8-5b70-85cd-cc58b51ca981 spider: auto1.fr
2025-12-05 17:04:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 75fd18ae-35c8-5b70-85cd-cc58b51ca981 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 19792, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dp90188', 'expiration_date': '2025-12-06t16:57:19z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '75fd18ae-35c8-5b70-85cd-cc58b51ca981', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 19792}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:57:19z',
'fuel_type': 'petrol',
'id': '75fd18ae-35c8-5b70-85cd-cc58b51ca981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dp90188',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 19792,
'odometer_in_km': 19792,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-21',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:57:19Z',
'fuel_type': 'petrol',
'id': '75fd18ae-35c8-5b70-85cd-cc58b51ca981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP90188',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 19792,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-21',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP90188%27 HTTP/1.1" 200 None
2025-12-05 17:04:26 [auto1.fr] INFO: Saving data for DP90188: {'auction_closing_time': 1765040239.0, 'created_time': 1764782019.483332, 'last_price_update_time': 1764954266.857996}
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP90188') HTTP/1.1" 204 0
2025-12-05 17:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf5badaf-998b-5ff2-afec-9e2b2f5d16db with identifier: SD43033
2025-12-05 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf5badaf-998b-5ff2-afec-9e2b2f5d16db with identifier: SD43033
2025-12-05 17:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf5badaf-998b-5ff2-afec-9e2b2f5d16db with identifier: SD43033 to the API
2025-12-05 17:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD43033>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:30:35Z',
'fuel_type': 'electro',
'id': 'cf5badaf-998b-5ff2-afec-9e2b2f5d16db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD43033',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 10623,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-25',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD43033%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [auto1.fr] INFO: Saving data for SD43033: {'auction_closing_time': 1765038635.0, 'created_time': 1764782275.316248, 'last_price_update_time': 1764954267.178643}
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SD43033') HTTP/1.1" 204 0
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR33594> (referer: https://www.auto1.com/v1/car-details-view/WR33594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE60105> (referer: https://www.auto1.com/v1/car-details-view/ZE60105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a25017-b729-5c57-a33c-e578339097d7 with identifier: WR33594
2025-12-05 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a25017-b729-5c57-a33c-e578339097d7 with scrape type 2
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a25017-b729-5c57-a33c-e578339097d7 with scrape type 2
2025-12-05 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 92a25017-b729-5c57-a33c-e578339097d7, identifier: WR33594
2025-12-05 17:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 92a25017-b729-5c57-a33c-e578339097d7 with identifier: WR33594
2025-12-05 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 92a25017-b729-5c57-a33c-e578339097d7 with identifier: WR33594
2025-12-05 17:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 92a25017-b729-5c57-a33c-e578339097d7 with identifier: WR33594 to the API
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WR33594>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:11:47Z',
'fuel_type': 'petrol',
'id': '92a25017-b729-5c57-a33c-e578339097d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR33594',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 16353,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-21',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR33594%27 HTTP/1.1" 200 None
2025-12-05 17:04:27 [auto1.fr] INFO: Saving data for WR33594: {'auction_closing_time': 1765037507.0, 'created_time': 1764782381.869345, 'last_price_update_time': 1764954267.712239}
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WR33594') HTTP/1.1" 204 0
2025-12-05 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0a4f79e-90c8-58c2-bb74-0513a7f5a483 with identifier: ZE60105
2025-12-05 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a4f79e-90c8-58c2-bb74-0513a7f5a483 with scrape type 2
2025-12-05 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0a4f79e-90c8-58c2-bb74-0513a7f5a483 with scrape type 2
2025-12-05 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0a4f79e-90c8-58c2-bb74-0513a7f5a483, identifier: ZE60105
2025-12-05 17:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0a4f79e-90c8-58c2-bb74-0513a7f5a483 with identifier: ZE60105
2025-12-05 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0a4f79e-90c8-58c2-bb74-0513a7f5a483 with identifier: ZE60105
2025-12-05 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 36919, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ze60105', 'expiration_date': '2025-12-06t16:11:37z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'd0a4f79e-90c8-58c2-bb74-0513a7f5a483', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 36919}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:11:37z',
'fuel_type': 'petrol',
'id': 'd0a4f79e-90c8-58c2-bb74-0513a7f5a483',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ze60105',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 36919,
'odometer_in_km': 36919,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: d0a4f79e-90c8-58c2-bb74-0513a7f5a483 spider: auto1.fr
2025-12-05 17:04:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d0a4f79e-90c8-58c2-bb74-0513a7f5a483 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 36919, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ze60105', 'expiration_date': '2025-12-06t16:11:37z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'd0a4f79e-90c8-58c2-bb74-0513a7f5a483', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 36919}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:11:37z',
'fuel_type': 'petrol',
'id': 'd0a4f79e-90c8-58c2-bb74-0513a7f5a483',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ze60105',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 36919,
'odometer_in_km': 36919,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:11:37Z',
'fuel_type': 'petrol',
'id': 'd0a4f79e-90c8-58c2-bb74-0513a7f5a483',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE60105',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 36919,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE60105%27 HTTP/1.1" 200 None
2025-12-05 17:04:28 [auto1.fr] INFO: Saving data for ZE60105: {'auction_closing_time': 1765037497.0, 'created_time': 1764781967.272968, 'last_price_update_time': 1764954268.039182}
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZE60105') HTTP/1.1" 204 0
2025-12-05 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC15744> (referer: https://www.auto1.com/v1/car-details-view/BC15744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT70384> (referer: https://www.auto1.com/v1/car-details-view/JT70384/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH01021> (referer: https://www.auto1.com/v1/car-details-view/BH01021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ30657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF21079> (referer: https://www.auto1.com/v1/car-details-view/NF21079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1659e0ed-f45c-5433-a740-e232cc5d3152 with identifier: BC15744
2025-12-05 17:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1659e0ed-f45c-5433-a740-e232cc5d3152 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1659e0ed-f45c-5433-a740-e232cc5d3152 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1659e0ed-f45c-5433-a740-e232cc5d3152, identifier: BC15744
2025-12-05 17:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e644cbac-1bdc-56fb-8666-9d9da220fc53 with identifier: JT70384
2025-12-05 17:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e644cbac-1bdc-56fb-8666-9d9da220fc53 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e644cbac-1bdc-56fb-8666-9d9da220fc53 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e644cbac-1bdc-56fb-8666-9d9da220fc53, identifier: JT70384
2025-12-05 17:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12 with identifier: BH01021
2025-12-05 17:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12 with scrape type 2
2025-12-05 17:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12, identifier: BH01021
2025-12-05 17:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1659e0ed-f45c-5433-a740-e232cc5d3152 with identifier: BC15744
2025-12-05 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1659e0ed-f45c-5433-a740-e232cc5d3152 with identifier: BC15744
2025-12-05 17:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1659e0ed-f45c-5433-a740-e232cc5d3152 with identifier: BC15744 to the API
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC15744>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:03:43Z',
'fuel_type': 'diesel',
'id': '1659e0ed-f45c-5433-a740-e232cc5d3152',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC15744',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Renault',
'model': 'Megane',
'odometer': 47595,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2021}
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC15744%27 HTTP/1.1" 200 None
2025-12-05 17:04:28 [auto1.fr] INFO: Saving data for BC15744: {'auction_closing_time': 1765037023.0, 'created_time': 1762275619.683611, 'last_price_update_time': 1764954268.766653}
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC15744') HTTP/1.1" 204 0
2025-12-05 17:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e644cbac-1bdc-56fb-8666-9d9da220fc53 with identifier: JT70384
2025-12-05 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e644cbac-1bdc-56fb-8666-9d9da220fc53 with identifier: JT70384
2025-12-05 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 63993, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-03', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jt70384', 'expiration_date': '2025-12-06t16:11:24z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'e644cbac-1bdc-56fb-8666-9d9da220fc53', 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63993}
Failed validating None in schema:
False
On instance:
{'age_in_months': 90,
'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:11:24z',
'fuel_type': 'petrol',
'id': 'e644cbac-1bdc-56fb-8666-9d9da220fc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jt70384',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 63993,
'odometer_in_km': 63993,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-03',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2018}
2025-12-05 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e644cbac-1bdc-56fb-8666-9d9da220fc53 spider: auto1.fr
2025-12-05 17:04:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e644cbac-1bdc-56fb-8666-9d9da220fc53 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 63993, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-03', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jt70384', 'expiration_date': '2025-12-06t16:11:24z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'e644cbac-1bdc-56fb-8666-9d9da220fc53', 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63993}
Failed validating None in schema:
False
On instance:
{'age_in_months': 90,
'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:11:24z',
'fuel_type': 'petrol',
'id': 'e644cbac-1bdc-56fb-8666-9d9da220fc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jt70384',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 63993,
'odometer_in_km': 63993,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-03',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:11:24Z',
'fuel_type': 'petrol',
'id': 'e644cbac-1bdc-56fb-8666-9d9da220fc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT70384',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Peugeot',
'model': '3008',
'odometer': 63993,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT70384%27 HTTP/1.1" 200 None
2025-12-05 17:04:28 [auto1.fr] INFO: Saving data for JT70384: {'auction_closing_time': 1765037484.0, 'created_time': 1764781254.190656, 'last_price_update_time': 1764954268.97646}
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JT70384') HTTP/1.1" 204 0
2025-12-05 17:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12 with identifier: BH01021
2025-12-05 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12 with identifier: BH01021
2025-12-05 17:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40ec8e26-3ad3-5e72-a52f-f4ab584d1a12 with identifier: BH01021 to the API
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH01021>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:26:19Z',
'fuel_type': 'diesel',
'id': '40ec8e26-3ad3-5e72-a52f-f4ab584d1a12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH01021',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Renault',
'model': 'Clio',
'odometer': 92519,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2017}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH01021%27 HTTP/1.1" 200 None
2025-12-05 17:04:29 [auto1.fr] INFO: Saving data for BH01021: {'auction_closing_time': 1765038379.0, 'created_time': 1764867705.59651, 'last_price_update_time': 1764954269.281881}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH01021') HTTP/1.1" 204 0
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK94283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ce2d2c-d4bd-53b7-9fa2-71587d681440 with identifier: NF21079
2025-12-05 17:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ce2d2c-d4bd-53b7-9fa2-71587d681440 with scrape type 2
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ce2d2c-d4bd-53b7-9fa2-71587d681440 with scrape type 2
2025-12-05 17:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60ce2d2c-d4bd-53b7-9fa2-71587d681440, identifier: NF21079
2025-12-05 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP40036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM03961> (referer: https://www.auto1.com/v1/car-details-view/SM03961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60ce2d2c-d4bd-53b7-9fa2-71587d681440 with identifier: NF21079
2025-12-05 17:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60ce2d2c-d4bd-53b7-9fa2-71587d681440 with identifier: NF21079
2025-12-05 17:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60ce2d2c-d4bd-53b7-9fa2-71587d681440 with identifier: NF21079 to the API
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF21079>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:32:21Z',
'fuel_type': 'electro',
'id': '60ce2d2c-d4bd-53b7-9fa2-71587d681440',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF21079',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 18420,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-22',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW Action Plus',
'transmission': 'automatic',
'trim': 'Action Plus',
'year': 2023}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF21079%27 HTTP/1.1" 200 None
2025-12-05 17:04:29 [auto1.fr] INFO: Saving data for NF21079: {'auction_closing_time': 1765038741.0, 'created_time': 1764782297.191888, 'last_price_update_time': 1764954269.743007}
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NF21079') HTTP/1.1" 204 0
2025-12-05 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3aedbf3-a36b-5e75-a388-f3d317d82473 with identifier: SM03961
2025-12-05 17:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3aedbf3-a36b-5e75-a388-f3d317d82473 with scrape type 2
2025-12-05 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3aedbf3-a36b-5e75-a388-f3d317d82473 with scrape type 2
2025-12-05 17:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c3aedbf3-a36b-5e75-a388-f3d317d82473, identifier: SM03961
2025-12-05 17:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c3aedbf3-a36b-5e75-a388-f3d317d82473 with identifier: SM03961
2025-12-05 17:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c3aedbf3-a36b-5e75-a388-f3d317d82473 with identifier: SM03961
2025-12-05 17:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 29810, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sm03961', 'expiration_date': '2025-12-06t16:23:48z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'c3aedbf3-a36b-5e75-a388-f3d317d82473', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 29810}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:48z',
'fuel_type': 'petrol',
'id': 'c3aedbf3-a36b-5e75-a388-f3d317d82473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sm03961',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 29810,
'odometer_in_km': 29810,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: c3aedbf3-a36b-5e75-a388-f3d317d82473 spider: auto1.fr
2025-12-05 17:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c3aedbf3-a36b-5e75-a388-f3d317d82473 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 29810, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sm03961', 'expiration_date': '2025-12-06t16:23:48z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'c3aedbf3-a36b-5e75-a388-f3d317d82473', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 29810}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:48z',
'fuel_type': 'petrol',
'id': 'c3aedbf3-a36b-5e75-a388-f3d317d82473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sm03961',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 29810,
'odometer_in_km': 29810,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:23:48Z',
'fuel_type': 'petrol',
'id': 'c3aedbf3-a36b-5e75-a388-f3d317d82473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM03961',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 29810,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM03961%27 HTTP/1.1" 200 None
2025-12-05 17:04:30 [auto1.fr] INFO: Saving data for SM03961: {'auction_closing_time': 1765038228.0, 'created_time': 1764781563.770478, 'last_price_update_time': 1764954270.095188}
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM03961') HTTP/1.1" 204 0
2025-12-05 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ04401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD05888> (referer: https://www.auto1.com/v1/car-details-view/YD05888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY74317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC31199> (referer: https://www.auto1.com/v1/car-details-view/SC31199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1070fdbc-970d-5cb3-a401-649bfb819a7d with identifier: YD05888
2025-12-05 17:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1070fdbc-970d-5cb3-a401-649bfb819a7d with scrape type 2
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1070fdbc-970d-5cb3-a401-649bfb819a7d with scrape type 2
2025-12-05 17:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1070fdbc-970d-5cb3-a401-649bfb819a7d, identifier: YD05888
2025-12-05 17:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1070fdbc-970d-5cb3-a401-649bfb819a7d with identifier: YD05888
2025-12-05 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1070fdbc-970d-5cb3-a401-649bfb819a7d with identifier: YD05888
2025-12-05 17:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1070fdbc-970d-5cb3-a401-649bfb819a7d with identifier: YD05888 to the API
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD05888>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:24:44Z',
'fuel_type': 'petrol',
'id': '1070fdbc-970d-5cb3-a401-649bfb819a7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD05888',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 21130,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-28',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD05888%27 HTTP/1.1" 200 None
2025-12-05 17:04:30 [auto1.fr] INFO: Saving data for YD05888: {'auction_closing_time': 1765038284.0, 'created_time': 1764781561.590921, 'last_price_update_time': 1764954270.974026}
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YD05888') HTTP/1.1" 204 0
2025-12-05 17:04:30 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 with identifier: SC31199
2025-12-05 17:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 with scrape type 1
2025-12-05 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_3c662b6535177825ac6da32ac138cfb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_3c662b6535177825ac6da32ac138cfb7.jpg not downloaded yet
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: VC10323
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC10323%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for VC10323: 0
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: WJ66404
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ66404%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for WJ66404: 0
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: YC19124
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC19124%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for YC19124: 0
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: KN66088
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN66088%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for KN66088: 0
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: BG80116
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG80116%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for BG80116: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_c1cced6ab8dc6ba09387ed1003726a30.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c1cced6ab8dc6ba09387ed1003726a30.jpg not downloaded yet
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: XN07206
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN07206%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for XN07206: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_f02163c65137a1323b3588885b16ed66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_f02163c65137a1323b3588885b16ed66.jpg not downloaded yet
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ60998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: ZV76318
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV76318%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for ZV76318: 1
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_c6245ba085e98c899a3d328ea72fbaa1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c6245ba085e98c899a3d328ea72fbaa1.jpg not downloaded yet
2025-12-05 17:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ69035> (referer: https://www.auto1.com/v1/car-details-view/XZ69035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: CX95434
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX95434%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for CX95434: 1
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_aaef3afc10a0626795e95e38ebdf5499.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_aaef3afc10a0626795e95e38ebdf5499.jpg not downloaded yet
2025-12-05 17:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: HT42696
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT42696%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for HT42696: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7bcd307d8276436e0a4790697af4b394.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7bcd307d8276436e0a4790697af4b394.jpg not downloaded yet
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: AK44167
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK44167%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for AK44167: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7dff632a52b57cdc0e7d7f4596cd8a7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7dff632a52b57cdc0e7d7f4596cd8a7e.jpg not downloaded yet
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: VY92561
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY92561%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for VY92561: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7f036b576d6cbd163dcd79fc48eadd96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7f036b576d6cbd163dcd79fc48eadd96.jpg not downloaded yet
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: ZP62258
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP62258%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for ZP62258: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_6ad0a788a960c1725dec4c542719da45.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_6ad0a788a960c1725dec4c542719da45.jpg not downloaded yet
2025-12-05 17:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead with identifier: XZ69035
2025-12-05 17:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead with scrape type 1
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_f3119bdd7577d7342c822a5219f23df8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_80fd0c181a8ed51b96da666da068b844.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_b60c7c009648f241c8fa16548e44aae2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_d5168a635cb073ab026e4a734b0b9033.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_984d380ee62852330be927e3bd858214.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_5d54267554d60152a596f7db211d8022.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_ee144075de45611988b516986bd4fd1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg already downloaded
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F32%252F44322f8fabc4a66a1b654fde71adad61%252Fpa%252FXZ69035_d1e403e6a98ab73e57457ce0e7672609.png%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png already downloaded
2025-12-05 17:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead, identifier: XZ69035
2025-12-05 17:04:31 [auto1.fr] INFO: Found listing with ID: VF52876
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF52876%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [auto1.fr] INFO: Scrape type for VF52876: 2
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_5eb0918ed1701797e170bf32e81a4a41.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_5eb0918ed1701797e170bf32e81a4a41.jpg not downloaded yet
2025-12-05 17:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead with identifier: XZ69035
2025-12-05 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead with identifier: XZ69035
2025-12-05 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 108383, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz69035', 'expiration_date': '2025-12-06t16:50:06z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72910}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70632}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58890}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45968}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74045}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58917}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83554}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60272}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 98593}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 82083}], 'current_year_diff': 6, 'age_in_months': 76, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 108383}
Failed validating None in schema:
False
On instance:
{'age_in_months': 76,
'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:50:06z',
'fuel_type': 'petrol',
'id': '8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz69035',
'listing': 'auction',
'location': 'fr, saint aignan de grandlieu',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 108383,
'odometer_in_km': 108383,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82083,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-14',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech active business',
'transmission': 'manual',
'trim': 'active business',
'year': 2019}
2025-12-05 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead spider: auto1.fr
2025-12-05 17:04:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 108383, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz69035', 'expiration_date': '2025-12-06t16:50:06z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg', 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72910}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70632}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58890}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45968}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74045}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58917}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83554}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60272}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55998}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 98593}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 82083}], 'current_year_diff': 6, 'age_in_months': 76, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 108383}
Failed validating None in schema:
False
On instance:
{'age_in_months': 76,
'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:50:06z',
'fuel_type': 'petrol',
'id': '8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz69035',
'listing': 'auction',
'location': 'fr, saint aignan de grandlieu',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 108383,
'odometer_in_km': 108383,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82083,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-14',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech active business',
'transmission': 'manual',
'trim': 'active business',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:50:06Z',
'fuel_type': 'petrol',
'id': '8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ69035',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Peugeot',
'model': '5008',
'odometer': 108383,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg',
'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_4442e9bde3ed34feb32e7fc26186b4fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d9a4be7836ecd967146136ce664cd0bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_304c7d4d7f81a78fbf520a6e4a58ea71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_f3119bdd7577d7342c822a5219f23df8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_56c9212bcda256a4c043f4c6e21d6d03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_80fd0c181a8ed51b96da666da068b844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_b60c7c009648f241c8fa16548e44aae2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_7cecdc62aa68fa5afe9b74d28d4a871e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d5168a635cb073ab026e4a734b0b9033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_984d380ee62852330be927e3bd858214.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_54de98135c5fc3fa37dddb953c7ba174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_5d54267554d60152a596f7db211d8022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_892b1c10d6cd6d5a8f8e30446ca94e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_ee144075de45611988b516986bd4fd1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_a45ee8e828e9833b7dd926f33d7bf176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead/8875ca3d-bdf7-5b8d-b517-fdc3ceb34ead_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82083,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img44/32/44322f8fabc4a66a1b654fde71adad61/pa/XZ69035_d1e403e6a98ab73e57457ce0e7672609.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-14',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2019}
2025-12-05 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ69035%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [auto1.fr] INFO: Saving data for XZ69035: {'created_time': 1764954272.002148, 'last_price_update_time': 1764954272.002159, 'auction_closing_time': 1765039806.0}
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XZ69035') HTTP/1.1" 204 0
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c6245ba085e98c899a3d328ea72fbaa1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_f02163c65137a1323b3588885b16ed66.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:32 [auto1.fr] INFO: Found listing with ID: ND23721
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND23721%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [auto1.fr] INFO: Scrape type for ND23721: 1
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_8a116f0c3c73e6fcccf795c3834ed310.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_8a116f0c3c73e6fcccf795c3834ed310.jpg not downloaded yet
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT88600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF17814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD63915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP30057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:32 [auto1.fr] INFO: Found listing with ID: VM80539
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM80539%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [auto1.fr] INFO: Scrape type for VM80539: 2
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7da4cb79430c830eb8f679686121c0a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7da4cb79430c830eb8f679686121c0a0.jpg not downloaded yet
2025-12-05 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:32 [auto1.fr] INFO: Found listing with ID: LB62071
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB62071%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [auto1.fr] INFO: Scrape type for LB62071: 2
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_b8af56aba07b12deeb3585a33d5a1d7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_b8af56aba07b12deeb3585a33d5a1d7b.jpg not downloaded yet
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c53510>
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_c6245ba085e98c899a3d328ea72fbaa1.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c6245ba085e98c899a3d328ea72fbaa1.jpg saved to cache
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57d4b90>
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_f02163c65137a1323b3588885b16ed66.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_f02163c65137a1323b3588885b16ed66.jpg saved to cache
2025-12-05 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:32 [auto1.fr] INFO: Found listing with ID: PU05475
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU05475%27 HTTP/1.1" 200 None
2025-12-05 17:04:32 [auto1.fr] INFO: Scrape type for PU05475: 2
2025-12-05 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_eb6845ffb5e665522aee52264c82d084.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_eb6845ffb5e665522aee52264c82d084.jpg not downloaded yet
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_5eb0918ed1701797e170bf32e81a4a41.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_8a116f0c3c73e6fcccf795c3834ed310.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_6ad0a788a960c1725dec4c542719da45.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: WF59773
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF59773%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for WF59773: 1
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_4b4236b90d89b943bc72faf22f765784.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_4b4236b90d89b943bc72faf22f765784.jpg not downloaded yet
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK94361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: BY34409
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY34409%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for BY34409: 1
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7a7f8938f05b3e25100c9965c7204150.png%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7a7f8938f05b3e25100c9965c7204150.png not downloaded yet
2025-12-05 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: WF88675
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF88675%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for WF88675: 2
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: KS56768
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS56768%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for KS56768: 2
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: GS52059
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS52059%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for GS52059: 2
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: KL89113
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL89113%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for KL89113: 2
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4deea50>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_5eb0918ed1701797e170bf32e81a4a41.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_5eb0918ed1701797e170bf32e81a4a41.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd36d0>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_8a116f0c3c73e6fcccf795c3834ed310.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_8a116f0c3c73e6fcccf795c3834ed310.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_b8af56aba07b12deeb3585a33d5a1d7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_eb6845ffb5e665522aee52264c82d084.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: JY96879
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY96879%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for JY96879: 1
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f0a50>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_6ad0a788a960c1725dec4c542719da45.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_6ad0a788a960c1725dec4c542719da45.jpg saved to cache
2025-12-05 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_4b4236b90d89b943bc72faf22f765784.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ30657> (referer: https://www.auto1.com/v1/car-details-view/GJ30657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:33 [auto1.fr] INFO: Found listing with ID: EC60090
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC60090%27 HTTP/1.1" 200 None
2025-12-05 17:04:33 [auto1.fr] INFO: Scrape type for EC60090: 2
2025-12-05 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET93870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4a790>
2025-12-05 17:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_b8af56aba07b12deeb3585a33d5a1d7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_b8af56aba07b12deeb3585a33d5a1d7b.jpg saved to cache
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5742e50>
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_eb6845ffb5e665522aee52264c82d084.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_eb6845ffb5e665522aee52264c82d084.jpg saved to cache
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:34 [auto1.fr] INFO: Found listing with ID: ES57929
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES57929%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [auto1.fr] INFO: Scrape type for ES57929: 1
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [auto1.fr] INFO: Found listing with ID: MT12965
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT12965%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [auto1.fr] INFO: Scrape type for MT12965: 1
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP40036> (referer: https://www.auto1.com/v1/car-details-view/JP40036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578a5d0>
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_4b4236b90d89b943bc72faf22f765784.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_4b4236b90d89b943bc72faf22f765784.jpg saved to cache
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff with identifier: GJ30657
2025-12-05 17:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff with scrape type 1
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg not downloaded yet
2025-12-05 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:34 [auto1.fr] INFO: Found listing with ID: VL55766
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL55766%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [auto1.fr] INFO: Scrape type for VL55766: 2
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_90969908842832f1c182f9321bbdfabf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg not downloaded yet
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX46284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY46442> (referer: https://www.auto1.com/v1/car-details-view/AY46442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK94283> (referer: https://www.auto1.com/v1/car-details-view/DK94283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83900d29-509d-5c89-a9c5-3a9256a37e27 with identifier: JP40036
2025-12-05 17:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83900d29-509d-5c89-a9c5-3a9256a37e27 with scrape type 2
2025-12-05 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83900d29-509d-5c89-a9c5-3a9256a37e27 with scrape type 2
2025-12-05 17:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83900d29-509d-5c89-a9c5-3a9256a37e27, identifier: JP40036
2025-12-05 17:04:34 [auto1.fr] INFO: Found listing with ID: LX05561
2025-12-05 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX05561%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [auto1.fr] INFO: Scrape type for LX05561: 2
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_69d6fc39903db66456a5daac630e1579.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg not downloaded yet
2025-12-05 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83900d29-509d-5c89-a9c5-3a9256a37e27 with identifier: JP40036
2025-12-05 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83900d29-509d-5c89-a9c5-3a9256a37e27 with identifier: JP40036
2025-12-05 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat punto 1.2 pop', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': 'punto', 'transmission': 'manual', 'odometer': 151510, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp40036', 'expiration_date': '2025-12-06t16:37:25z', 'origin_country_code': 'fr', 'trim': 'pop', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, creutzwald', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': '83900d29-509d-5c89-a9c5-3a9256a37e27', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'fiat punto', 'sanitized_make': 'fiat', 'odometer_in_km': 151510}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 70,
'expiration_date': '2025-12-06t16:37:25z',
'fuel_type': 'petrol',
'id': '83900d29-509d-5c89-a9c5-3a9256a37e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp40036',
'listing': 'auction',
'location': 'fr, creutzwald',
'make': 'fiat',
'make_model': 'fiat punto',
'model': 'punto',
'odometer': 151510,
'odometer_in_km': 151510,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-20',
'sanitized_make': 'fiat',
'seats_number': 5,
'seller_name': None,
'title': 'fiat punto 1.2 pop',
'transmission': 'manual',
'trim': 'pop',
'year': 2016}
2025-12-05 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 83900d29-509d-5c89-a9c5-3a9256a37e27 spider: auto1.fr
2025-12-05 17:04:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 83900d29-509d-5c89-a9c5-3a9256a37e27 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat punto 1.2 pop', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': 'punto', 'transmission': 'manual', 'odometer': 151510, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp40036', 'expiration_date': '2025-12-06t16:37:25z', 'origin_country_code': 'fr', 'trim': 'pop', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, creutzwald', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': '83900d29-509d-5c89-a9c5-3a9256a37e27', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'fiat punto', 'sanitized_make': 'fiat', 'odometer_in_km': 151510}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 70,
'expiration_date': '2025-12-06t16:37:25z',
'fuel_type': 'petrol',
'id': '83900d29-509d-5c89-a9c5-3a9256a37e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jp40036',
'listing': 'auction',
'location': 'fr, creutzwald',
'make': 'fiat',
'make_model': 'fiat punto',
'model': 'punto',
'odometer': 151510,
'odometer_in_km': 151510,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-20',
'sanitized_make': 'fiat',
'seats_number': 5,
'seller_name': None,
'title': 'fiat punto 1.2 pop',
'transmission': 'manual',
'trim': 'pop',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:37:25Z',
'fuel_type': 'petrol',
'id': '83900d29-509d-5c89-a9c5-3a9256a37e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP40036',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Fiat',
'model': 'Punto',
'odometer': 151510,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2016}
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP40036%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [auto1.fr] INFO: Saving data for JP40036: {'auction_closing_time': 1765039045.0, 'created_time': 1760115781.612767, 'last_price_update_time': 1764954275.223219}
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP40036') HTTP/1.1" 204 0
2025-12-05 17:04:35 [auto1.fr] INFO: Found listing with ID: HM61859
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM61859%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [auto1.fr] INFO: Scrape type for HM61859: 1
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg not downloaded yet
2025-12-05 17:04:35 [auto1.fr] INFO: Found listing with ID: ZC79503
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC79503%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [auto1.fr] INFO: Scrape type for ZC79503: 1
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_4d72d4a2025568083cad55e0c1eada98.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg not downloaded yet
2025-12-05 17:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d95005c1-3b4b-5a30-9359-587816cfe89d with identifier: AY46442
2025-12-05 17:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d95005c1-3b4b-5a30-9359-587816cfe89d with scrape type 2
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d95005c1-3b4b-5a30-9359-587816cfe89d with scrape type 2
2025-12-05 17:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d95005c1-3b4b-5a30-9359-587816cfe89d, identifier: AY46442
2025-12-05 17:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e58782-87b7-5675-beaa-5e42fd2b942d with identifier: DK94283
2025-12-05 17:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e58782-87b7-5675-beaa-5e42fd2b942d with scrape type 2
2025-12-05 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88e58782-87b7-5675-beaa-5e42fd2b942d with scrape type 2
2025-12-05 17:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 88e58782-87b7-5675-beaa-5e42fd2b942d, identifier: DK94283
2025-12-05 17:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH76441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d95005c1-3b4b-5a30-9359-587816cfe89d with identifier: AY46442
2025-12-05 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d95005c1-3b4b-5a30-9359-587816cfe89d with identifier: AY46442
2025-12-05 17:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d95005c1-3b4b-5a30-9359-587816cfe89d with identifier: AY46442 to the API
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY46442>
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 195,
'expiration_date': '2025-12-06T16:49:41Z',
'fuel_type': 'diesel',
'id': 'd95005c1-3b4b-5a30-9359-587816cfe89d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY46442',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 63692,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-15',
'seats_number': 4,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY46442%27 HTTP/1.1" 200 None
2025-12-05 17:04:35 [auto1.fr] INFO: Saving data for AY46442: {'auction_closing_time': 1765039781.0, 'created_time': 1764263277.597737, 'last_price_update_time': 1764954275.913882}
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY46442') HTTP/1.1" 204 0
2025-12-05 17:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 88e58782-87b7-5675-beaa-5e42fd2b942d with identifier: DK94283
2025-12-05 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 88e58782-87b7-5675-beaa-5e42fd2b942d with identifier: DK94283
2025-12-05 17:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 88e58782-87b7-5675-beaa-5e42fd2b942d with identifier: DK94283 to the API
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK94283>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:50:20Z',
'fuel_type': 'diesel',
'id': '88e58782-87b7-5675-beaa-5e42fd2b942d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK94283',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 67930,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-28',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK94283%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Saving data for DK94283: {'auction_closing_time': 1765039820.0, 'created_time': 1763546692.456907, 'last_price_update_time': 1764954276.553271}
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DK94283') HTTP/1.1" 204 0
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: WZ78680
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ78680%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for WZ78680: 1
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg not downloaded yet
2025-12-05 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ04401> (referer: https://www.auto1.com/v1/car-details-view/BJ04401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF52876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: WN63847
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN63847%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for WN63847: 1
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg not downloaded yet
2025-12-05 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: WC77266
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC77266%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for WC77266: 2
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_9db263a0fb208381de62f748934c19d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg not downloaded yet
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: VM00106
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM00106%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for VM00106: 1
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_639b5db7a017ec61a6a728d629c49e60.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg not downloaded yet
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: ZA89800
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA89800%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for ZA89800: 2
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg not downloaded yet
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: TB81364
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB81364%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for TB81364: 1
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_56eca106702111bb061891dc0ba8635f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg not downloaded yet
2025-12-05 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3 with identifier: BJ04401
2025-12-05 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3 with scrape type 2
2025-12-05 17:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3, identifier: BJ04401
2025-12-05 17:04:36 [auto1.fr] INFO: Found listing with ID: BJ78204
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ78204%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [auto1.fr] INFO: Scrape type for BJ78204: 1
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg not downloaded yet
2025-12-05 17:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3 with identifier: BJ04401
2025-12-05 17:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3 with identifier: BJ04401
2025-12-05 17:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3 with identifier: BJ04401 to the API
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ04401>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': 'Taxi',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 241,
'expiration_date': '2025-12-06T16:11:22Z',
'fuel_type': 'hybrid',
'id': '201aa1b3-a40e-51a0-ad64-43a3dbb2ccd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ04401',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 74853,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2022}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ04401%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.fr] INFO: Saving data for BJ04401: {'auction_closing_time': 1765037482.0, 'created_time': 1764237767.192939, 'last_price_update_time': 1764954277.318213}
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BJ04401') HTTP/1.1" 204 0
2025-12-05 17:04:37 [auto1.fr] INFO: Found listing with ID: KH23745
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH23745%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.fr] INFO: Scrape type for KH23745: 1
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg not downloaded yet
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP62258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB62071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL89113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:37 [auto1.fr] INFO: Found listing with ID: ZT50667
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT50667%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [auto1.fr] INFO: Scrape type for ZT50667: 1
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_359207f7f94274464ed1ec0dd87a6361.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg not downloaded yet
2025-12-05 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg not downloaded yet
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_b054f959ae506a7eaad3287bcd4e2b65.png%27 HTTP/1.1" 200 None
2025-12-05 17:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png not downloaded yet
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND23721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png> (referer: https://www.auto1.com/)
2025-12-05 17:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f0b50>
2025-12-05 17:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_90969908842832f1c182f9321bbdfabf.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg saved to cache
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS52059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY96879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d45490>
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg saved to cache
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:38 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:04:38 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:04:38 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582a010>
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_15.png HTTP/1.1" 201 0
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_b054f959ae506a7eaad3287bcd4e2b65.png') HTTP/1.1" 204 0
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png saved to cache
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS56768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC60090/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1ef50>
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg saved to cache
2025-12-05 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5937710>
2025-12-05 17:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL55766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX17543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET93870> (referer: https://www.auto1.com/v1/car-details-view/ET93870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES57929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d14362-93ee-5050-be9e-d2ae52ad33d9 with identifier: ET93870
2025-12-05 17:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d14362-93ee-5050-be9e-d2ae52ad33d9 with scrape type 1
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_c46fef7da5cddf9fa536b534507365be.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg not downloaded yet
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg not downloaded yet
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_439c98e552c0455430d39f968311044a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg not downloaded yet
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg not downloaded yet
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582ae50>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg not downloaded yet
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_f346c974a3943f48990797817524c44e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg not downloaded yet
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5777450>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_359207f7f94274464ed1ec0dd87a6361.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg saved to cache
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_81a1cc10fd39576ade9f6c94daef2556.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg not downloaded yet
2025-12-05 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_32f815bc7b249db1d59e3e77afb2442b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg not downloaded yet
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5991b10>
2025-12-05 17:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_56eca106702111bb061891dc0ba8635f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg saved to cache
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_479f382bc1decc5fe376d69e90ea6320.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg not downloaded yet
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg not downloaded yet
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH23745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX46284> (referer: https://www.auto1.com/v1/car-details-view/GX46284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg not downloaded yet
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c4850>
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_439c98e552c0455430d39f968311044a.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg saved to cache
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_f9b52e88a72495fc519f3b63089cf915.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg not downloaded yet
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT50667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL89113> (referer: https://www.auto1.com/v1/car-details-view/KL89113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB62071> (referer: https://www.auto1.com/v1/car-details-view/LB62071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP62258> (referer: https://www.auto1.com/v1/car-details-view/ZP62258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e0b310>
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg saved to cache
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d6232a-03d5-5b12-a33e-909e17253164 with identifier: GX46284
2025-12-05 17:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d6232a-03d5-5b12-a33e-909e17253164 with scrape type 2
2025-12-05 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d6232a-03d5-5b12-a33e-909e17253164 with scrape type 2
2025-12-05 17:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e6d6232a-03d5-5b12-a33e-909e17253164, identifier: GX46284
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_05c553501a6a424c3a5a96be2c79bde1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg not downloaded yet
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e6d6232a-03d5-5b12-a33e-909e17253164 with identifier: GX46284
2025-12-05 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e6d6232a-03d5-5b12-a33e-909e17253164 with identifier: GX46284
2025-12-05 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 140073 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
140073
2025-12-05 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: e6d6232a-03d5-5b12-a33e-909e17253164 spider: auto1.fr
2025-12-05 17:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e6d6232a-03d5-5b12-a33e-909e17253164 due to rule: high_mileage_for_make.json, error: 140073 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
140073
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:34:58Z',
'fuel_type': 'diesel',
'id': 'e6d6232a-03d5-5b12-a33e-909e17253164',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX46284',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Fiat',
'model': '500X',
'odometer': 140073,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.3 M-Jet Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX46284%27 HTTP/1.1" 200 None
2025-12-05 17:04:41 [auto1.fr] INFO: Saving data for GX46284: {'auction_closing_time': 1765038898.0, 'created_time': 1764756476.526535, 'last_price_update_time': 1764954281.294384}
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX46284') HTTP/1.1" 204 0
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg not downloaded yet
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND23721> (referer: https://www.auto1.com/v1/car-details-view/ND23721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ78680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5890b50>
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_81a1cc10fd39576ade9f6c94daef2556.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg saved to cache
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b2690>
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_32f815bc7b249db1d59e3e77afb2442b.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg saved to cache
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f160dc-30de-58b1-9175-1d39bbc08a77 with identifier: KL89113
2025-12-05 17:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f160dc-30de-58b1-9175-1d39bbc08a77 with scrape type 2
2025-12-05 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45f160dc-30de-58b1-9175-1d39bbc08a77 with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 45f160dc-30de-58b1-9175-1d39bbc08a77, identifier: KL89113
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bde28bd3-a931-58e0-b9a0-850f79c20087 with identifier: LB62071
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bde28bd3-a931-58e0-b9a0-850f79c20087 with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bde28bd3-a931-58e0-b9a0-850f79c20087 with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bde28bd3-a931-58e0-b9a0-850f79c20087, identifier: LB62071
2025-12-05 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1dcfbb4-52c9-500b-954a-979ceef94332 with identifier: ZP62258
2025-12-05 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1dcfbb4-52c9-500b-954a-979ceef94332 with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1dcfbb4-52c9-500b-954a-979ceef94332 with scrape type 2
2025-12-05 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1dcfbb4-52c9-500b-954a-979ceef94332, identifier: ZP62258
2025-12-05 17:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 45f160dc-30de-58b1-9175-1d39bbc08a77 with identifier: KL89113
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 45f160dc-30de-58b1-9175-1d39bbc08a77 with identifier: KL89113
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 34852, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl89113', 'expiration_date': '2025-12-06t16:26:29z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '45f160dc-30de-58b1-9175-1d39bbc08a77', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 34852}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:26:29z',
'fuel_type': 'petrol',
'id': '45f160dc-30de-58b1-9175-1d39bbc08a77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl89113',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 34852,
'odometer_in_km': 34852,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-06',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo elegance',
'transmission': 'manual',
'trim': 'elegance',
'year': 2023}
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 45f160dc-30de-58b1-9175-1d39bbc08a77 spider: auto1.fr
2025-12-05 17:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 45f160dc-30de-58b1-9175-1d39bbc08a77 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 34852, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl89113', 'expiration_date': '2025-12-06t16:26:29z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '45f160dc-30de-58b1-9175-1d39bbc08a77', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 34852}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:26:29z',
'fuel_type': 'petrol',
'id': '45f160dc-30de-58b1-9175-1d39bbc08a77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl89113',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 34852,
'odometer_in_km': 34852,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-06',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo elegance',
'transmission': 'manual',
'trim': 'elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:26:29Z',
'fuel_type': 'petrol',
'id': '45f160dc-30de-58b1-9175-1d39bbc08a77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL89113',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 34852,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2023}
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL89113%27 HTTP/1.1" 200 None
2025-12-05 17:04:42 [auto1.fr] INFO: Saving data for KL89113: {'auction_closing_time': 1765038389.0, 'created_time': 1764756250.153135, 'last_price_update_time': 1764954282.501721}
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL89113') HTTP/1.1" 204 0
2025-12-05 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bde28bd3-a931-58e0-b9a0-850f79c20087 with identifier: LB62071
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bde28bd3-a931-58e0-b9a0-850f79c20087 with identifier: LB62071
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 41600, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb62071', 'expiration_date': '2025-12-06t16:23:46z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'bde28bd3-a931-58e0-b9a0-850f79c20087', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 41600}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:46z',
'fuel_type': 'petrol',
'id': 'bde28bd3-a931-58e0-b9a0-850f79c20087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb62071',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 41600,
'odometer_in_km': 41600,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-31',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: bde28bd3-a931-58e0-b9a0-850f79c20087 spider: auto1.fr
2025-12-05 17:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bde28bd3-a931-58e0-b9a0-850f79c20087 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 41600, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb62071', 'expiration_date': '2025-12-06t16:23:46z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'bde28bd3-a931-58e0-b9a0-850f79c20087', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 41600}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:46z',
'fuel_type': 'petrol',
'id': 'bde28bd3-a931-58e0-b9a0-850f79c20087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lb62071',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 41600,
'odometer_in_km': 41600,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-31',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:23:46Z',
'fuel_type': 'petrol',
'id': 'bde28bd3-a931-58e0-b9a0-850f79c20087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB62071',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 41600,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB62071%27 HTTP/1.1" 200 None
2025-12-05 17:04:42 [auto1.fr] INFO: Saving data for LB62071: {'auction_closing_time': 1765038226.0, 'created_time': 1764782249.14663, 'last_price_update_time': 1764954282.723578}
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LB62071') HTTP/1.1" 204 0
2025-12-05 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1dcfbb4-52c9-500b-954a-979ceef94332 with identifier: ZP62258
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1dcfbb4-52c9-500b-954a-979ceef94332 with identifier: ZP62258
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 32696, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp62258', 'expiration_date': '2025-12-06t16:27:50z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b1dcfbb4-52c9-500b-954a-979ceef94332', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 32696}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:27:50z',
'fuel_type': 'petrol',
'id': 'b1dcfbb4-52c9-500b-954a-979ceef94332',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp62258',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 32696,
'odometer_in_km': 32696,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: b1dcfbb4-52c9-500b-954a-979ceef94332 spider: auto1.fr
2025-12-05 17:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b1dcfbb4-52c9-500b-954a-979ceef94332 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 32696, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp62258', 'expiration_date': '2025-12-06t16:27:50z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b1dcfbb4-52c9-500b-954a-979ceef94332', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 32696}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:27:50z',
'fuel_type': 'petrol',
'id': 'b1dcfbb4-52c9-500b-954a-979ceef94332',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp62258',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 32696,
'odometer_in_km': 32696,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:27:50Z',
'fuel_type': 'petrol',
'id': 'b1dcfbb4-52c9-500b-954a-979ceef94332',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP62258',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 32696,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP62258%27 HTTP/1.1" 200 None
2025-12-05 17:04:42 [auto1.fr] INFO: Saving data for ZP62258: {'auction_closing_time': 1765038470.0, 'created_time': 1764782211.014428, 'last_price_update_time': 1764954282.932988}
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP62258') HTTP/1.1" 204 0
2025-12-05 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_73e86205e3e5b421fd7878977762f1c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg not downloaded yet
2025-12-05 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg not downloaded yet
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f7ed0>
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg saved to cache
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b5150>
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_479f382bc1decc5fe376d69e90ea6320.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg saved to cache
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3eebf1b-5830-5971-953e-f8e30e39f029 with identifier: ND23721
2025-12-05 17:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3eebf1b-5830-5971-953e-f8e30e39f029 with scrape type 1
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg not downloaded yet
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_575233283950e0c541525d715d31bde8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg not downloaded yet
2025-12-05 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ec9250>
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_f9b52e88a72495fc519f3b63089cf915.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg saved to cache
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b08190>
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg saved to cache
2025-12-05 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a72e50>
2025-12-05 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a72e50>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_c46fef7da5cddf9fa536b534507365be.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_db38b9042782e0db25ba0904ca19ff59.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg not downloaded yet
2025-12-05 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_80c2e478f538c4894039a040c6d2cc82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg not downloaded yet
2025-12-05 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ78204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY96879> (referer: https://www.auto1.com/v1/car-details-view/JY96879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c586fd10>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d7ee10>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_05c553501a6a424c3a5a96be2c79bde1.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg saved to cache
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_ffa73b95d262eadaf288351a2282152e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg not downloaded yet
2025-12-05 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57d5450>
2025-12-05 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_73e86205e3e5b421fd7878977762f1c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg saved to cache
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 211ecd27-7f9f-5f3f-b75a-708456b83dec with identifier: JY96879
2025-12-05 17:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211ecd27-7f9f-5f3f-b75a-708456b83dec with scrape type 1
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_76f9a02991fd80d5dff1b5e768bd2806.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_76f9a02991fd80d5dff1b5e768bd2806.jpg not downloaded yet
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_2b70ffb89225fc54d4d832592745941c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg not downloaded yet
2025-12-05 17:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg not downloaded yet
2025-12-05 17:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_be9532b4626d8caa881adfa6a61ca2be.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg not downloaded yet
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f06090>
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg saved to cache
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_8f9c3356417e5aaa7b0e72738d17fbff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_8f9c3356417e5aaa7b0e72738d17fbff.jpg not downloaded yet
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg not downloaded yet
2025-12-05 17:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_3f138e31ae870d0f89e8a7b522fa3776.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3f138e31ae870d0f89e8a7b522fa3776.jpg not downloaded yet
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ae98d0>
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg saved to cache
2025-12-05 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c83bd0>
2025-12-05 17:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_db38b9042782e0db25ba0904ca19ff59.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg saved to cache
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5893d50>
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_575233283950e0c541525d715d31bde8.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg saved to cache
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg not downloaded yet
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_78b40f03a0888d6bbfc4114da2b7b621.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_78b40f03a0888d6bbfc4114da2b7b621.jpg not downloaded yet
2025-12-05 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg not downloaded yet
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58bebd0>
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_80c2e478f538c4894039a040c6d2cc82.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg saved to cache
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_a5e2eb5284c471a86c417d7b757c8f32.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a5e2eb5284c471a86c417d7b757c8f32.jpg not downloaded yet
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_695f32fd62f78f850bafc4f4ba17747d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg not downloaded yet
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_0af21e4f4a4887911b6918c36b273c58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_0af21e4f4a4887911b6918c36b273c58.jpg not downloaded yet
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5935550>
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_2b70ffb89225fc54d4d832592745941c.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg saved to cache
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_ea47ea45381c32fa040d65664ba7478e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg not downloaded yet
2025-12-05 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_d91c3cd910de81a84868a9618990246c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d91c3cd910de81a84868a9618990246c.jpg not downloaded yet
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg not downloaded yet
2025-12-05 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_fd79b0fa9298b398b235ab4a77f4f216.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fd79b0fa9298b398b235ab4a77f4f216.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_67e68e31488cdeac6c74d592e247587d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_422b19ee029af83d9d66eecb78accbcf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_422b19ee029af83d9d66eecb78accbcf.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_4cb22c6373024e9379897c506ffb2364.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_1bd8bd764e267b415112f221bbd41fd6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_1bd8bd764e267b415112f221bbd41fd6.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_3c902c136941607040d9b871b8a7301d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3c902c136941607040d9b871b8a7301d.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_835c73d5eee87701dfc01aa4879c403a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_835c73d5eee87701dfc01aa4879c403a.jpg not downloaded yet
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c599b350>
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg saved to cache
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg not downloaded yet
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_fbf9f8ef87ebf73a6eb8aaca8706c82e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fbf9f8ef87ebf73a6eb8aaca8706c82e.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_eea9ca5449618883c92df126b009011a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_f6b4e0f42b1baa595050c0bf4d1163aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_f6b4e0f42b1baa595050c0bf4d1163aa.jpg not downloaded yet
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg not downloaded yet
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_d37d703f980174f884b3f34d0a8fd9f2.png%27 HTTP/1.1" 200 None
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d37d703f980174f884b3f34d0a8fd9f2.png not downloaded yet
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_835c73d5eee87701dfc01aa4879c403a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_76f9a02991fd80d5dff1b5e768bd2806.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_8f9c3356417e5aaa7b0e72738d17fbff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0ea10>
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_ea47ea45381c32fa040d65664ba7478e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg saved to cache
2025-12-05 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c46390>
2025-12-05 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_f346c974a3943f48990797817524c44e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg saved to cache
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e2c950>
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F2a%252F4e2a120bd2062341bb693e976d529828%252Fpa%252FET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg saved to cache
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7d14362-93ee-5050-be9e-d2ae52ad33d9
2025-12-05 17:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7d14362-93ee-5050-be9e-d2ae52ad33d9, skipping ID generation
2025-12-05 17:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d14362-93ee-5050-be9e-d2ae52ad33d9 with scrape type 1
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7d14362-93ee-5050-be9e-d2ae52ad33d9 from tracking dictionaries
2025-12-05 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7d14362-93ee-5050-be9e-d2ae52ad33d9 sending to next pipeline
2025-12-05 17:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c7d14362-93ee-5050-be9e-d2ae52ad33d9, identifier: ET93870
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a66250>
2025-12-05 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_835c73d5eee87701dfc01aa4879c403a.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_835c73d5eee87701dfc01aa4879c403a.jpg saved to cache
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e2ed10>
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_76f9a02991fd80d5dff1b5e768bd2806.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_76f9a02991fd80d5dff1b5e768bd2806.jpg saved to cache
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e2f390>
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_8f9c3356417e5aaa7b0e72738d17fbff.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_8f9c3356417e5aaa7b0e72738d17fbff.jpg saved to cache
2025-12-05 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c7d14362-93ee-5050-be9e-d2ae52ad33d9 with identifier: ET93870
2025-12-05 17:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c7d14362-93ee-5050-be9e-d2ae52ad33d9 with identifier: ET93870
2025-12-05 17:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 32416, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et93870', 'expiration_date': '2025-12-06t16:02:05z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-denis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': 'c7d14362-93ee-5050-be9e-d2ae52ad33d9', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69208}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2802337}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57288}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63015}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2771238}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58459}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68563}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56512}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53580}], 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 32416}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 68,
'expiration_date': '2025-12-06t16:02:05z',
'fuel_type': 'petrol',
'id': 'c7d14362-93ee-5050-be9e-d2ae52ad33d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et93870',
'listing': 'auction',
'location': 'fr, saint-denis',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 32416,
'odometer_in_km': 32416,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2802337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2771238,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech like',
'transmission': 'manual',
'trim': 'like',
'year': 2017}
2025-12-05 17:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c7d14362-93ee-5050-be9e-d2ae52ad33d9 spider: auto1.fr
2025-12-05 17:04:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c7d14362-93ee-5050-be9e-d2ae52ad33d9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 32416, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et93870', 'expiration_date': '2025-12-06t16:02:05z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-denis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': 'c7d14362-93ee-5050-be9e-d2ae52ad33d9', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69208}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2802337}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57288}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63015}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2771238}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58459}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68563}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56512}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53580}], 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 32416}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 68,
'expiration_date': '2025-12-06t16:02:05z',
'fuel_type': 'petrol',
'id': 'c7d14362-93ee-5050-be9e-d2ae52ad33d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/et93870',
'listing': 'auction',
'location': 'fr, saint-denis',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 32416,
'odometer_in_km': 32416,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2802337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2771238,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-27',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech like',
'transmission': 'manual',
'trim': 'like',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 68,
'expiration_date': '2025-12-06T16:02:05Z',
'fuel_type': 'petrol',
'id': 'c7d14362-93ee-5050-be9e-d2ae52ad33d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET93870',
'listing': 'auction',
'location': 'FR, Saint-Denis',
'make': 'Peugeot',
'model': '208',
'odometer': 32416,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_c46fef7da5cddf9fa536b534507365be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_6a8d408ec57c86ecd8ea96cf6df387a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_439c98e552c0455430d39f968311044a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_e0b14f6a0e3c08b7f0eac731659643da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_a3aa708493c1f7b904cb4158cd66ef1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2802337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f346c974a3943f48990797817524c44e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_81a1cc10fd39576ade9f6c94daef2556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_32f815bc7b249db1d59e3e77afb2442b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_479f382bc1decc5fe376d69e90ea6320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_9b24119530f64d3eafc8bd0dd6a00d7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2771238,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_4ea5701b988a14b25cbdbcdf3e5bc179.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_f9b52e88a72495fc519f3b63089cf915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_05c553501a6a424c3a5a96be2c79bde1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_8c8efd55cdb9a03a97c742a8cb422e07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_73e86205e3e5b421fd7878977762f1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d14362-93ee-5050-be9e-d2ae52ad33d9/c7d14362-93ee-5050-be9e-d2ae52ad33d9_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/2a/4e2a120bd2062341bb693e976d529828/pa/ET93870_1dd7cb6decca7b220a0d422638aa2ea8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2017}
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET93870%27 HTTP/1.1" 200 None
2025-12-05 17:04:50 [auto1.fr] INFO: Saving data for ET93870: {'created_time': 1764954290.082357, 'last_price_update_time': 1764954290.082368, 'auction_closing_time': 1765036925.0}
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ET93870') HTTP/1.1" 204 0
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES57929> (referer: https://www.auto1.com/v1/car-details-view/ES57929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d37d703f980174f884b3f34d0a8fd9f2.png> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fbf9f8ef87ebf73a6eb8aaca8706c82e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_f6b4e0f42b1baa595050c0bf4d1163aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b87cfcd-abad-5cb6-9458-c2fc901a41bd with identifier: ES57929
2025-12-05 17:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd with scrape type 1
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_514016b238e1ac78dd0a075a5b5f4b0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_514016b238e1ac78dd0a075a5b5f4b0f.jpg not downloaded yet
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_4451a8ba4834808654fd1cc6b60759ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_4451a8ba4834808654fd1cc6b60759ea.jpg not downloaded yet
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_a9b7c0aaad8680a9dce12138390abde1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a9b7c0aaad8680a9dce12138390abde1.jpg not downloaded yet
2025-12-05 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_d8d898460ec5bca14a6ad7f2e866738a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d8d898460ec5bca14a6ad7f2e866738a.jpg not downloaded yet
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_8c3b089b6e0f14f9a8666c0481546fd4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8c3b089b6e0f14f9a8666c0481546fd4.jpg not downloaded yet
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5773450>
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_eea9ca5449618883c92df126b009011a.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg saved to cache
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1a7d0>
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg saved to cache
2025-12-05 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e65b90>
2025-12-05 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:04:51 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:04:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:04:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ecb710>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_15.png HTTP/1.1" 201 0
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_d37d703f980174f884b3f34d0a8fd9f2.png') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d37d703f980174f884b3f34d0a8fd9f2.png saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_514016b238e1ac78dd0a075a5b5f4b0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_a0ac4206087712561311c1b2292ea2ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a0ac4206087712561311c1b2292ea2ce.jpg not downloaded yet
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5927510>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_fbf9f8ef87ebf73a6eb8aaca8706c82e.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fbf9f8ef87ebf73a6eb8aaca8706c82e.jpg saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594ee10>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_f6b4e0f42b1baa595050c0bf4d1163aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_f6b4e0f42b1baa595050c0bf4d1163aa.jpg saved to cache
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS52059> (referer: https://www.auto1.com/v1/car-details-view/GS52059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF52876> (referer: https://www.auto1.com/v1/car-details-view/VF52876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH23745> (referer: https://www.auto1.com/v1/car-details-view/KH23745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_919068692aeeefe28f6c0d20df1392e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_919068692aeeefe28f6c0d20df1392e4.jpg not downloaded yet
2025-12-05 17:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5916d90>
2025-12-05 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c50450>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_4cb22c6373024e9379897c506ffb2364.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fbf50>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cc2610>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_67e68e31488cdeac6c74d592e247587d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg saved to cache
2025-12-05 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d4a90>
2025-12-05 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_514016b238e1ac78dd0a075a5b5f4b0f.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_514016b238e1ac78dd0a075a5b5f4b0f.jpg saved to cache
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_552317ec6606c203ad0c4946ea97c23d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_552317ec6606c203ad0c4946ea97c23d.jpg not downloaded yet
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_17f52869f8c1d39499f771b25ee305b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_17f52869f8c1d39499f771b25ee305b5.jpg not downloaded yet
2025-12-05 17:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL55766> (referer: https://www.auto1.com/v1/car-details-view/VL55766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 052aa091-161f-5649-944e-accff505decc with identifier: GS52059
2025-12-05 17:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052aa091-161f-5649-944e-accff505decc with scrape type 2
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 052aa091-161f-5649-944e-accff505decc with scrape type 2
2025-12-05 17:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 052aa091-161f-5649-944e-accff505decc, identifier: GS52059
2025-12-05 17:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7185fda6-0d33-5277-8cc6-23b08e40ae14 with identifier: VF52876
2025-12-05 17:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7185fda6-0d33-5277-8cc6-23b08e40ae14 with scrape type 2
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7185fda6-0d33-5277-8cc6-23b08e40ae14 with scrape type 2
2025-12-05 17:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7185fda6-0d33-5277-8cc6-23b08e40ae14, identifier: VF52876
2025-12-05 17:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac78fb2-52e2-52cf-a36f-988d2ac18669 with identifier: KH23745
2025-12-05 17:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669 with scrape type 1
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_a77d1e6e45290e03a5c5a924fffcb96d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a77d1e6e45290e03a5c5a924fffcb96d.jpg not downloaded yet
2025-12-05 17:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 052aa091-161f-5649-944e-accff505decc with identifier: GS52059
2025-12-05 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 052aa091-161f-5649-944e-accff505decc with identifier: GS52059
2025-12-05 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 35784, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs52059', 'expiration_date': '2025-12-06t16:07:19z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '052aa091-161f-5649-944e-accff505decc', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 35784}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:07:19z',
'fuel_type': 'petrol',
'id': '052aa091-161f-5649-944e-accff505decc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs52059',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 35784,
'odometer_in_km': 35784,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 052aa091-161f-5649-944e-accff505decc spider: auto1.fr
2025-12-05 17:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 052aa091-161f-5649-944e-accff505decc due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 35784, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs52059', 'expiration_date': '2025-12-06t16:07:19z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '052aa091-161f-5649-944e-accff505decc', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 35784}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:07:19z',
'fuel_type': 'petrol',
'id': '052aa091-161f-5649-944e-accff505decc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs52059',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 35784,
'odometer_in_km': 35784,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:07:19Z',
'fuel_type': 'petrol',
'id': '052aa091-161f-5649-944e-accff505decc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS52059',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 35784,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS52059%27 HTTP/1.1" 200 None
2025-12-05 17:04:53 [auto1.fr] INFO: Saving data for GS52059: {'auction_closing_time': 1765037239.0, 'created_time': 1764756464.757933, 'last_price_update_time': 1764954293.752455}
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS52059') HTTP/1.1" 204 0
2025-12-05 17:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7185fda6-0d33-5277-8cc6-23b08e40ae14 with identifier: VF52876
2025-12-05 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7185fda6-0d33-5277-8cc6-23b08e40ae14 with identifier: VF52876
2025-12-05 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 elegance business', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 17377, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf52876', 'expiration_date': '2025-12-06t16:16:18z', 'origin_country_code': 'fr', 'trim': 'elegance business', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '7185fda6-0d33-5277-8cc6-23b08e40ae14', 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 17377}
Failed validating None in schema:
False
On instance:
{'age_in_months': 29,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 75,
'expiration_date': '2025-12-06t16:16:18z',
'fuel_type': 'petrol',
'id': '7185fda6-0d33-5277-8cc6-23b08e40ae14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf52876',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 17377,
'odometer_in_km': 17377,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-14',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 elegance business',
'transmission': 'manual',
'trim': 'elegance business',
'year': 2023}
2025-12-05 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 7185fda6-0d33-5277-8cc6-23b08e40ae14 spider: auto1.fr
2025-12-05 17:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7185fda6-0d33-5277-8cc6-23b08e40ae14 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 elegance business', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 17377, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf52876', 'expiration_date': '2025-12-06t16:16:18z', 'origin_country_code': 'fr', 'trim': 'elegance business', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '7185fda6-0d33-5277-8cc6-23b08e40ae14', 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 17377}
Failed validating None in schema:
False
On instance:
{'age_in_months': 29,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 75,
'expiration_date': '2025-12-06t16:16:18z',
'fuel_type': 'petrol',
'id': '7185fda6-0d33-5277-8cc6-23b08e40ae14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf52876',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 17377,
'odometer_in_km': 17377,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-14',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 elegance business',
'transmission': 'manual',
'trim': 'elegance business',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:16:18Z',
'fuel_type': 'petrol',
'id': '7185fda6-0d33-5277-8cc6-23b08e40ae14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF52876',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Corsa',
'odometer': 17377,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Elegance Business',
'transmission': 'manual',
'trim': 'Elegance Business',
'year': 2023}
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF52876%27 HTTP/1.1" 200 None
2025-12-05 17:04:53 [auto1.fr] INFO: Saving data for VF52876: {'auction_closing_time': 1765037778.0, 'created_time': 1764756461.024654, 'last_price_update_time': 1764954293.974634}
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VF52876') HTTP/1.1" 204 0
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_7b75fb281c78845945baa0b348bc506d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_7b75fb281c78845945baa0b348bc506d.jpg not downloaded yet
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_5f5d52362a953fe9286d5764ea48d826.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5f5d52362a953fe9286d5764ea48d826.jpg not downloaded yet
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d8d898460ec5bca14a6ad7f2e866738a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a0ac4206087712561311c1b2292ea2ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_14f8a53228094b3df4f9f840602f9c2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_14f8a53228094b3df4f9f840602f9c2a.jpg not downloaded yet
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_57b4b74f571c8b20dce1d5fdbfc50f18.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_57b4b74f571c8b20dce1d5fdbfc50f18.jpg not downloaded yet
2025-12-05 17:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f909a720-cce7-587d-8a94-26d04cd0e517 with identifier: VL55766
2025-12-05 17:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f909a720-cce7-587d-8a94-26d04cd0e517 with scrape type 2
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f909a720-cce7-587d-8a94-26d04cd0e517 with scrape type 2
2025-12-05 17:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f909a720-cce7-587d-8a94-26d04cd0e517, identifier: VL55766
2025-12-05 17:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f909a720-cce7-587d-8a94-26d04cd0e517 with identifier: VL55766
2025-12-05 17:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f909a720-cce7-587d-8a94-26d04cd0e517 with identifier: VL55766
2025-12-05 17:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech feel xl', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'automatic', 'odometer': 93118, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vl55766', 'expiration_date': '2025-12-06t16:48:28z', 'origin_country_code': 'fr', 'trim': 'feel xl', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'f909a720-cce7-587d-8a94-26d04cd0e517', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 93118}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:48:28z',
'fuel_type': 'petrol',
'id': 'f909a720-cce7-587d-8a94-26d04cd0e517',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vl55766',
'listing': 'auction',
'location': 'fr, warluis',
'make': 'citroen',
'make_model': 'citroen berlingo',
'model': 'berlingo',
'odometer': 93118,
'odometer_in_km': 93118,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-27',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen berlingo 1.2 puretech feel xl',
'transmission': 'automatic',
'trim': 'feel xl',
'year': 2019}
2025-12-05 17:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f909a720-cce7-587d-8a94-26d04cd0e517 spider: auto1.fr
2025-12-05 17:04:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f909a720-cce7-587d-8a94-26d04cd0e517 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech feel xl', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'automatic', 'odometer': 93118, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vl55766', 'expiration_date': '2025-12-06t16:48:28z', 'origin_country_code': 'fr', 'trim': 'feel xl', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'f909a720-cce7-587d-8a94-26d04cd0e517', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 93118}
Failed validating None in schema:
False
On instance:
{'age_in_months': 72,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:48:28z',
'fuel_type': 'petrol',
'id': 'f909a720-cce7-587d-8a94-26d04cd0e517',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vl55766',
'listing': 'auction',
'location': 'fr, warluis',
'make': 'citroen',
'make_model': 'citroen berlingo',
'model': 'berlingo',
'odometer': 93118,
'odometer_in_km': 93118,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-27',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen berlingo 1.2 puretech feel xl',
'transmission': 'automatic',
'trim': 'feel xl',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:48:28Z',
'fuel_type': 'petrol',
'id': 'f909a720-cce7-587d-8a94-26d04cd0e517',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL55766',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 93118,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.2 PureTech Feel XL',
'transmission': 'automatic',
'trim': 'Feel XL',
'year': 2019}
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL55766%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [auto1.fr] INFO: Saving data for VL55766: {'auction_closing_time': 1765039708.0, 'created_time': 1764655271.441599, 'last_price_update_time': 1764954294.398945}
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VL55766') HTTP/1.1" 204 0
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_ceea9509b357667cf26fc48fd20df039.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_ceea9509b357667cf26fc48fd20df039.jpg not downloaded yet
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_5323fa56388fc563bb09c53c377cab83.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5323fa56388fc563bb09c53c377cab83.jpg not downloaded yet
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC60090> (referer: https://www.auto1.com/v1/car-details-view/EC60090/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f06d50>
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_d8d898460ec5bca14a6ad7f2e866738a.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d8d898460ec5bca14a6ad7f2e866738a.jpg saved to cache
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a72c90>
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_a0ac4206087712561311c1b2292ea2ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a0ac4206087712561311c1b2292ea2ce.jpg saved to cache
2025-12-05 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a9b7c0aaad8680a9dce12138390abde1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a77d1e6e45290e03a5c5a924fffcb96d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_d85264e6e2742de2062154184240e466.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d85264e6e2742de2062154184240e466.jpg not downloaded yet
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_45370913a35b6e46a203999b5b9a5d9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_45370913a35b6e46a203999b5b9a5d9f.jpg not downloaded yet
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_8d91fb1d23a62c266e21fccdfccc79fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8d91fb1d23a62c266e21fccdfccc79fb.jpg not downloaded yet
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_5da809e6ea89b9d4db0897be7fb42fa5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5da809e6ea89b9d4db0897be7fb42fa5.jpg not downloaded yet
2025-12-05 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT50667> (referer: https://www.auto1.com/v1/car-details-view/ZT50667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_5544783b4ec7960b767fe7799a7c5b45.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_5544783b4ec7960b767fe7799a7c5b45.jpg not downloaded yet
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_89e9df8c8b038bebdfbc1ffc4b5550eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_89e9df8c8b038bebdfbc1ffc4b5550eb.jpg not downloaded yet
2025-12-05 17:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85709ff8-33a6-539c-9c43-898129f8fd28 with identifier: EC60090
2025-12-05 17:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85709ff8-33a6-539c-9c43-898129f8fd28 with scrape type 2
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85709ff8-33a6-539c-9c43-898129f8fd28 with scrape type 2
2025-12-05 17:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 85709ff8-33a6-539c-9c43-898129f8fd28, identifier: EC60090
2025-12-05 17:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 85709ff8-33a6-539c-9c43-898129f8fd28 with identifier: EC60090
2025-12-05 17:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 85709ff8-33a6-539c-9c43-898129f8fd28 with identifier: EC60090
2025-12-05 17:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164338
2025-12-05 17:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 85709ff8-33a6-539c-9c43-898129f8fd28 spider: auto1.fr
2025-12-05 17:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 85709ff8-33a6-539c-9c43-898129f8fd28 due to rule: high_mileage_for_country.json, error: 164338 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164338
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2025-12-06T16:59:14Z',
'fuel_type': 'diesel',
'id': '85709ff8-33a6-539c-9c43-898129f8fd28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC60090',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Captur',
'odometer': 164338,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2016}
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC60090%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [auto1.fr] INFO: Saving data for EC60090: {'auction_closing_time': 1765040354.0, 'created_time': 1764782317.043002, 'last_price_update_time': 1764954295.423436}
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EC60090') HTTP/1.1" 204 0
2025-12-05 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5f5d52362a953fe9286d5764ea48d826.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_852b95849d1e3a6f53b906fa54328f24.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_852b95849d1e3a6f53b906fa54328f24.jpg not downloaded yet
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_cabdd5a12fd2ab957e7d702a1aae253e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_cabdd5a12fd2ab957e7d702a1aae253e.jpg not downloaded yet
2025-12-05 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_7b75fb281c78845945baa0b348bc506d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_9d6dcd892902ae520b176d02301aafee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_9d6dcd892902ae520b176d02301aafee.jpg not downloaded yet
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a7710>
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_a9b7c0aaad8680a9dce12138390abde1.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a9b7c0aaad8680a9dce12138390abde1.jpg saved to cache
2025-12-05 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd1d10>
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_a77d1e6e45290e03a5c5a924fffcb96d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a77d1e6e45290e03a5c5a924fffcb96d.jpg saved to cache
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69cfdc1-c1eb-5129-b148-9d75696d7efb with identifier: ZT50667
2025-12-05 17:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69cfdc1-c1eb-5129-b148-9d75696d7efb with scrape type 1
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_3f3f82e694166e85e7d2467eab67f360.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_3f3f82e694166e85e7d2467eab67f360.jpg not downloaded yet
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_422b19ee029af83d9d66eecb78accbcf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5323fa56388fc563bb09c53c377cab83.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_881527179e146762be465bfaec4a7d77.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_881527179e146762be465bfaec4a7d77.jpg not downloaded yet
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_2bd242f9dae028a8dddc849baca4072d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_2bd242f9dae028a8dddc849baca4072d.jpg not downloaded yet
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ78204> (referer: https://www.auto1.com/v1/car-details-view/BJ78204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c470d0>
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_5f5d52362a953fe9286d5764ea48d826.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5f5d52362a953fe9286d5764ea48d826.jpg saved to cache
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4efc6d0>
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_7b75fb281c78845945baa0b348bc506d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_7b75fb281c78845945baa0b348bc506d.jpg saved to cache
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_ceea9509b357667cf26fc48fd20df039.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_c588d57a9c8f02aeea4f07611fe21700.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_c588d57a9c8f02aeea4f07611fe21700.jpg not downloaded yet
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg not downloaded yet
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_fb9d1e20f3c20e230f08a5eb46a78906.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_fb9d1e20f3c20e230f08a5eb46a78906.jpg not downloaded yet
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_4cadfe1413a65c0a1b9c5d0bc59f5bdf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_4cadfe1413a65c0a1b9c5d0bc59f5bdf.jpg not downloaded yet
2025-12-05 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ78680> (referer: https://www.auto1.com/v1/car-details-view/WZ78680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591afd0>
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_422b19ee029af83d9d66eecb78accbcf.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_422b19ee029af83d9d66eecb78accbcf.jpg saved to cache
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e49250>
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_5323fa56388fc563bb09c53c377cab83.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5323fa56388fc563bb09c53c377cab83.jpg saved to cache
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 322f8fdf-9af6-54da-9d60-e30e4f859261 with identifier: BJ78204
2025-12-05 17:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322f8fdf-9af6-54da-9d60-e30e4f859261 with scrape type 1
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 322f8fdf-9af6-54da-9d60-e30e4f859261
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_a16eed5bc2e5de90db1b388f0be66faf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_a16eed5bc2e5de90db1b388f0be66faf.jpg not downloaded yet
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_1bd8bd764e267b415112f221bbd41fd6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3c902c136941607040d9b871b8a7301d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5da809e6ea89b9d4db0897be7fb42fa5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_89e9df8c8b038bebdfbc1ffc4b5550eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_57b4b74f571c8b20dce1d5fdbfc50f18.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_3575fff8ceca3c7ca7421a1019c700a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_3575fff8ceca3c7ca7421a1019c700a6.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_362e07d42edb0902d3f37f4610a23931.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_362e07d42edb0902d3f37f4610a23931.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_befbb1ce24af599d265d1e0eae30f339.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_befbb1ce24af599d265d1e0eae30f339.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_a2b92814281b3e08301599e226ebbe49.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a2b92814281b3e08301599e226ebbe49.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_ba8a7db3077fd9c3c26743a152afe2f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_ba8a7db3077fd9c3c26743a152afe2f2.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_44e0ebff165dbc89d7673ee45d6551b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_44e0ebff165dbc89d7673ee45d6551b4.jpg not downloaded yet
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a97bd0>
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_ceea9509b357667cf26fc48fd20df039.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_ceea9509b357667cf26fc48fd20df039.jpg saved to cache
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d57f431b-a53a-58a2-a578-d11f001a0151 with identifier: WZ78680
2025-12-05 17:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d57f431b-a53a-58a2-a578-d11f001a0151 with scrape type 1
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg not downloaded yet
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fd79b0fa9298b398b235ab4a77f4f216.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_881527179e146762be465bfaec4a7d77.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_3f3f82e694166e85e7d2467eab67f360.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_2bd242f9dae028a8dddc849baca4072d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_29a79ec90ae0658f2abb33595aaccd96.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_29a79ec90ae0658f2abb33595aaccd96.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_5bd905d3dfce4c302f8afe3084b63fb4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5bd905d3dfce4c302f8afe3084b63fb4.jpg not downloaded yet
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_65a5304b67648a40097de9935974b7bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_65a5304b67648a40097de9935974b7bc.jpg not downloaded yet
2025-12-05 17:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_9d6dcd892902ae520b176d02301aafee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg not downloaded yet
2025-12-05 17:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594e690>
2025-12-05 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_1bd8bd764e267b415112f221bbd41fd6.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_1bd8bd764e267b415112f221bbd41fd6.jpg saved to cache
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdd350>
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_3c902c136941607040d9b871b8a7301d.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3c902c136941607040d9b871b8a7301d.jpg saved to cache
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de6310>
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_5da809e6ea89b9d4db0897be7fb42fa5.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5da809e6ea89b9d4db0897be7fb42fa5.jpg saved to cache
2025-12-05 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb2c50>
2025-12-05 17:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_89e9df8c8b038bebdfbc1ffc4b5550eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_89e9df8c8b038bebdfbc1ffc4b5550eb.jpg saved to cache
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c60f90>
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_57b4b74f571c8b20dce1d5fdbfc50f18.jpg') HTTP/1.1" 204 0
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_57b4b74f571c8b20dce1d5fdbfc50f18.jpg saved to cache
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_cabdd5a12fd2ab957e7d702a1aae253e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_d5c8c808597d3d69bee85ddc8cdd3220.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_d5c8c808597d3d69bee85ddc8cdd3220.jpg not downloaded yet
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_bbbb2c9841284231d942abaa3fdbff5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_bbbb2c9841284231d942abaa3fdbff5a.jpg not downloaded yet
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_ee680c1029d5ee350ff1311b1d86a444.png%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_ee680c1029d5ee350ff1311b1d86a444.png not downloaded yet
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX17543> (referer: https://www.auto1.com/v1/car-details-view/KX17543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_2f78207da34c0feed26a5cc024364935.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg not downloaded yet
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_74b837ad5400c3576508ffb97ec64382.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_74b837ad5400c3576508ffb97ec64382.jpg not downloaded yet
2025-12-05 17:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB81364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:04:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef4ad0>
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_fd79b0fa9298b398b235ab4a77f4f216.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fd79b0fa9298b398b235ab4a77f4f216.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1c6d0>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_881527179e146762be465bfaec4a7d77.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_881527179e146762be465bfaec4a7d77.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e7290>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_3f3f82e694166e85e7d2467eab67f360.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_3f3f82e694166e85e7d2467eab67f360.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1efd0>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_2bd242f9dae028a8dddc849baca4072d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_2bd242f9dae028a8dddc849baca4072d.jpg saved to cache
2025-12-05 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e77890>
2025-12-05 17:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_9d6dcd892902ae520b176d02301aafee.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_9d6dcd892902ae520b176d02301aafee.jpg saved to cache
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_3016e47f92e721458b228c22409aa3de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg not downloaded yet
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_d4c8ec5c9b765a4380bab7239f0c3760.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_d4c8ec5c9b765a4380bab7239f0c3760.jpg not downloaded yet
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_6aac450712ec9d0c948692e5fe832791.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg not downloaded yet
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57e7a50>
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_cabdd5a12fd2ab957e7d702a1aae253e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_cabdd5a12fd2ab957e7d702a1aae253e.jpg saved to cache
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 with identifier: KX17543
2025-12-05 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 with scrape type 1
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_e91126a8c9e5497a6d3c78dd2cb09643.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e91126a8c9e5497a6d3c78dd2cb09643.jpg not downloaded yet
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_133f1e8c390ee2e6c1d1eb01911c9b88.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_133f1e8c390ee2e6c1d1eb01911c9b88.jpg not downloaded yet
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5bd905d3dfce4c302f8afe3084b63fb4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_49a2922121bed67bec60d208ca6b06ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg not downloaded yet
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_cb143032af0ce56f97582e4c2110b2ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_cb143032af0ce56f97582e4c2110b2ba.jpg not downloaded yet
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_65a5304b67648a40097de9935974b7bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_bbbb2c9841284231d942abaa3fdbff5a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_d5c8c808597d3d69bee85ddc8cdd3220.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_b6d14728d55e1be80da4337c82a30a61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_b6d14728d55e1be80da4337c82a30a61.jpg not downloaded yet
2025-12-05 17:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_ee680c1029d5ee350ff1311b1d86a444.png> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg not downloaded yet
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_dcc0936e78da36197ac27ee26c1dcf86.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_dcc0936e78da36197ac27ee26c1dcf86.jpg not downloaded yet
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_4451a8ba4834808654fd1cc6b60759ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_1fa16f98b0af84eea3bf1a6396aa346b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_1fa16f98b0af84eea3bf1a6396aa346b.jpg not downloaded yet
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_ba8a7db3077fd9c3c26743a152afe2f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a2b92814281b3e08301599e226ebbe49.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_d4d309a22b19002047c3c8946c1c0409.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg not downloaded yet
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_f82e8f83c1948e1ef1469eb0cd4c641a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_f82e8f83c1948e1ef1469eb0cd4c641a.jpg not downloaded yet
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_44e0ebff165dbc89d7673ee45d6551b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_960f3f062d30f3e156b185f0fc0471b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_960f3f062d30f3e156b185f0fc0471b1.jpg not downloaded yet
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57a9710>
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_5bd905d3dfce4c302f8afe3084b63fb4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5bd905d3dfce4c302f8afe3084b63fb4.jpg saved to cache
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg not downloaded yet
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_216c57cb4d3b0882cd76c78349c84b18.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_216c57cb4d3b0882cd76c78349c84b18.jpg not downloaded yet
2025-12-05 17:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_362e07d42edb0902d3f37f4610a23931.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_befbb1ce24af599d265d1e0eae30f339.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_f6554e7fe62e9b3c99f63473517f996c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f6554e7fe62e9b3c99f63473517f996c.jpg not downloaded yet
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5904d10>
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_65a5304b67648a40097de9935974b7bc.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_65a5304b67648a40097de9935974b7bc.jpg saved to cache
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 322f8fdf-9af6-54da-9d60-e30e4f859261
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57aa5d0>
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_bbbb2c9841284231d942abaa3fdbff5a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_bbbb2c9841284231d942abaa3fdbff5a.jpg saved to cache
2025-12-05 17:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9f550>
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_d5c8c808597d3d69bee85ddc8cdd3220.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_d5c8c808597d3d69bee85ddc8cdd3220.jpg saved to cache
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e2e1d0>
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg saved to cache
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:03 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:05:03 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:05:03 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0d590>
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_4.png HTTP/1.1" 201 0
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_ee680c1029d5ee350ff1311b1d86a444.png') HTTP/1.1" 204 0
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_ee680c1029d5ee350ff1311b1d86a444.png saved to cache
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 322f8fdf-9af6-54da-9d60-e30e4f859261
2025-12-05 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_29a79ec90ae0658f2abb33595aaccd96.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_c3e820800b8b50339752e406b16951ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg not downloaded yet
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_8504bfed9934975147556187ac5b9c86.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_8504bfed9934975147556187ac5b9c86.jpg not downloaded yet
2025-12-05 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8c3b089b6e0f14f9a8666c0481546fd4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e91126a8c9e5497a6d3c78dd2cb09643.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_133f1e8c390ee2e6c1d1eb01911c9b88.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_0f67d759468d9dc0b17b58b08101cb12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_0f67d759468d9dc0b17b58b08101cb12.jpg not downloaded yet
2025-12-05 17:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb2fd0>
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_4451a8ba4834808654fd1cc6b60759ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_4451a8ba4834808654fd1cc6b60759ea.jpg saved to cache
2025-12-05 17:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb2850>
2025-12-05 17:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_ba8a7db3077fd9c3c26743a152afe2f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_ba8a7db3077fd9c3c26743a152afe2f2.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e37710>
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_a2b92814281b3e08301599e226ebbe49.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a2b92814281b3e08301599e226ebbe49.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d10ad0>
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5810c90>
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_44e0ebff165dbc89d7673ee45d6551b4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_44e0ebff165dbc89d7673ee45d6551b4.jpg saved to cache
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 322f8fdf-9af6-54da-9d60-e30e4f859261
2025-12-05 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_d4c8ec5c9b765a4380bab7239f0c3760.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg not downloaded yet
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_d287f451785ae8f67c84ee6c8da8eef7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_d287f451785ae8f67c84ee6c8da8eef7.jpg not downloaded yet
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb56d0>
2025-12-05 17:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_362e07d42edb0902d3f37f4610a23931.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_362e07d42edb0902d3f37f4610a23931.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb6ed0>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_befbb1ce24af599d265d1e0eae30f339.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_befbb1ce24af599d265d1e0eae30f339.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 322f8fdf-9af6-54da-9d60-e30e4f859261
2025-12-05 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_b6d14728d55e1be80da4337c82a30a61.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_25c700c5800a368ef3777f9d8a382878.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_25c700c5800a368ef3777f9d8a382878.jpg not downloaded yet
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg not downloaded yet
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_5213fbd07c83ab452f8dcc4bc12519d8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_5213fbd07c83ab452f8dcc4bc12519d8.jpg not downloaded yet
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4deced0>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_29a79ec90ae0658f2abb33595aaccd96.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_29a79ec90ae0658f2abb33595aaccd96.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9d8d0>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_8c3b089b6e0f14f9a8666c0481546fd4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8c3b089b6e0f14f9a8666c0481546fd4.jpg saved to cache
2025-12-05 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4deef90>
2025-12-05 17:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_e91126a8c9e5497a6d3c78dd2cb09643.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e91126a8c9e5497a6d3c78dd2cb09643.jpg saved to cache
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4deec50>
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_133f1e8c390ee2e6c1d1eb01911c9b88.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_133f1e8c390ee2e6c1d1eb01911c9b88.jpg saved to cache
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_1fa16f98b0af84eea3bf1a6396aa346b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_dcc0936e78da36197ac27ee26c1dcf86.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_444d1e3b93009bfbfb8c32fde8096ca8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_444d1e3b93009bfbfb8c32fde8096ca8.jpg not downloaded yet
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_9905e7b1533ca415bd787a865453b4c2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg not downloaded yet
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_68fcf0a9b47518f4ded02f16b60d17af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_68fcf0a9b47518f4ded02f16b60d17af.jpg not downloaded yet
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a20710>
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_d4c8ec5c9b765a4380bab7239f0c3760.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_d4c8ec5c9b765a4380bab7239f0c3760.jpg saved to cache
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_815af4ab1fc8a9707551e3ebfb476820.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_815af4ab1fc8a9707551e3ebfb476820.jpg not downloaded yet
2025-12-05 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB81364> (referer: https://www.auto1.com/v1/car-details-view/TB81364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a215d0>
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_b6d14728d55e1be80da4337c82a30a61.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_b6d14728d55e1be80da4337c82a30a61.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_960f3f062d30f3e156b185f0fc0471b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_f82e8f83c1948e1ef1469eb0cd4c641a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_fc1f81767b8fce22fc56bce197e87730.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg not downloaded yet
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_64f219bf1f218b8da13d0c300e7bd986.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_64f219bf1f218b8da13d0c300e7bd986.jpg not downloaded yet
2025-12-05 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_25c700c5800a368ef3777f9d8a382878.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_5296c6b97ce12aeee684dbebb7566037.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5296c6b97ce12aeee684dbebb7566037.jpg not downloaded yet
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b4ab10>
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c69f10>
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_1fa16f98b0af84eea3bf1a6396aa346b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_1fa16f98b0af84eea3bf1a6396aa346b.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4effad0>
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_dcc0936e78da36197ac27ee26c1dcf86.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_dcc0936e78da36197ac27ee26c1dcf86.jpg saved to cache
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:07 [scrapy.extensions.logstats] INFO: Crawled 583 pages (at 106 pages/min), scraped 128 items (at 18 items/min)
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg not downloaded yet
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_de43b672a970c9132ae9cdd412430a03.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_de43b672a970c9132ae9cdd412430a03.jpg not downloaded yet
2025-12-05 17:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b177e63-b499-5b2a-8a5f-a8cd4435635c with identifier: TB81364
2025-12-05 17:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c with scrape type 1
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_a390c29f94e212e88576389e360ccc5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_a390c29f94e212e88576389e360ccc5c.jpg not downloaded yet
2025-12-05 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_0f67d759468d9dc0b17b58b08101cb12.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_86b3c737b4f91f40e926e403800be700.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png not downloaded yet
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_0d8284365f7629628ce0bce274d9ff05.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_0d8284365f7629628ce0bce274d9ff05.jpg not downloaded yet
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578dcd0>
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_960f3f062d30f3e156b185f0fc0471b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_960f3f062d30f3e156b185f0fc0471b1.jpg saved to cache
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a71790>
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_f82e8f83c1948e1ef1469eb0cd4c641a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_f82e8f83c1948e1ef1469eb0cd4c641a.jpg saved to cache
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3db90>
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_25c700c5800a368ef3777f9d8a382878.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_25c700c5800a368ef3777f9d8a382878.jpg saved to cache
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_b9437979e33f5889e791ffe9b462bf2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_b9437979e33f5889e791ffe9b462bf2f.jpg not downloaded yet
2025-12-05 17:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_e635b426a03d01219eaaa6b03d04c37f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e635b426a03d01219eaaa6b03d04c37f.jpg not downloaded yet
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_4e57f4ac9818bae1e3f3e461e2e5a626.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_4e57f4ac9818bae1e3f3e461e2e5a626.jpg not downloaded yet
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_1db6a5f4a8e5e45704699c182395aff3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_1db6a5f4a8e5e45704699c182395aff3.jpg not downloaded yet
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_559ad3421460f04ca2021822f6aba43b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_559ad3421460f04ca2021822f6aba43b.jpg not downloaded yet
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1ead0>
2025-12-05 17:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_0f67d759468d9dc0b17b58b08101cb12.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_0f67d759468d9dc0b17b58b08101cb12.jpg saved to cache
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_e7a1da68186cf0a989c2b335b1d7555d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e7a1da68186cf0a989c2b335b1d7555d.jpg not downloaded yet
2025-12-05 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_8504bfed9934975147556187ac5b9c86.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg not downloaded yet
2025-12-05 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_29b5d71a528c79090977a2b900a9fdb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_29b5d71a528c79090977a2b900a9fdb3.jpg not downloaded yet
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_da0a52acd5f90d58280483c34486c44d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_da0a52acd5f90d58280483c34486c44d.jpg not downloaded yet
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5e190>
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg saved to cache
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_874d7da8d7c8d61763641abe62365426.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_874d7da8d7c8d61763641abe62365426.jpg not downloaded yet
2025-12-05 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f6554e7fe62e9b3c99f63473517f996c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_9a3c43d8a09cff72b45ba78c0ffb9239.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_9a3c43d8a09cff72b45ba78c0ffb9239.jpg not downloaded yet
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_551f9b1592e3ee7ada6892847d415d0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_551f9b1592e3ee7ada6892847d415d0f.jpg not downloaded yet
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f5d90>
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_8504bfed9934975147556187ac5b9c86.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_8504bfed9934975147556187ac5b9c86.jpg saved to cache
2025-12-05 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dadf90>
2025-12-05 17:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_c3e820800b8b50339752e406b16951ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg saved to cache
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_815af4ab1fc8a9707551e3ebfb476820.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_1622c09ea418f3b4fef48f860b017a1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_1622c09ea418f3b4fef48f860b017a1d.jpg not downloaded yet
2025-12-05 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_68fcf0a9b47518f4ded02f16b60d17af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_c9cbe14d2ba659a0d1939a904bb9373c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_c9cbe14d2ba659a0d1939a904bb9373c.jpg not downloaded yet
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf1950>
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_f6554e7fe62e9b3c99f63473517f996c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f6554e7fe62e9b3c99f63473517f996c.jpg saved to cache
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579e8d0>
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg saved to cache
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_23b1d01f715bde98fcbdd002a26180fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_23b1d01f715bde98fcbdd002a26180fa.jpg not downloaded yet
2025-12-05 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_444d1e3b93009bfbfb8c32fde8096ca8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_605bae3718af7e31d1b683f1d1b11061.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_605bae3718af7e31d1b683f1d1b11061.jpg not downloaded yet
2025-12-05 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_0620eb7366abd8f9cbfc6597995013fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_0620eb7366abd8f9cbfc6597995013fb.jpg not downloaded yet
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d5fed0>
2025-12-05 17:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_815af4ab1fc8a9707551e3ebfb476820.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_815af4ab1fc8a9707551e3ebfb476820.jpg saved to cache
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a89490>
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_68fcf0a9b47518f4ded02f16b60d17af.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_68fcf0a9b47518f4ded02f16b60d17af.jpg saved to cache
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_10fbd33b91cce9b20def7d0f7bb0021b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_10fbd33b91cce9b20def7d0f7bb0021b.jpg not downloaded yet
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_de43b672a970c9132ae9cdd412430a03.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_0d8284365f7629628ce0bce274d9ff05.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_71ac5992f730a75749249334ca2d5c6f.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_71ac5992f730a75749249334ca2d5c6f.png not downloaded yet
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c576afd0>
2025-12-05 17:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_9905e7b1533ca415bd787a865453b4c2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ed890>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_444d1e3b93009bfbfb8c32fde8096ca8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_444d1e3b93009bfbfb8c32fde8096ca8.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4a890>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_2f78207da34c0feed26a5cc024364935.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg saved to cache
2025-12-05 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_874d7da8d7c8d61763641abe62365426.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e7a1da68186cf0a989c2b335b1d7555d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_559ad3421460f04ca2021822f6aba43b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_da0a52acd5f90d58280483c34486c44d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b247d0>
2025-12-05 17:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_6aac450712ec9d0c948692e5fe832791.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e64690>
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_de43b672a970c9132ae9cdd412430a03.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_de43b672a970c9132ae9cdd412430a03.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c98050>
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_0d8284365f7629628ce0bce274d9ff05.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_0d8284365f7629628ce0bce274d9ff05.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_605bae3718af7e31d1b683f1d1b11061.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_1622c09ea418f3b4fef48f860b017a1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_cb143032af0ce56f97582e4c2110b2ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_9a3c43d8a09cff72b45ba78c0ffb9239.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_c9cbe14d2ba659a0d1939a904bb9373c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_551f9b1592e3ee7ada6892847d415d0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58dd0d0>
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_49a2922121bed67bec60d208ca6b06ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg saved to cache
2025-12-05 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ecf50>
2025-12-05 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_874d7da8d7c8d61763641abe62365426.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_874d7da8d7c8d61763641abe62365426.jpg saved to cache
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dad7d0>
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_e7a1da68186cf0a989c2b335b1d7555d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e7a1da68186cf0a989c2b335b1d7555d.jpg saved to cache
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4daeb50>
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_559ad3421460f04ca2021822f6aba43b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_559ad3421460f04ca2021822f6aba43b.jpg saved to cache
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ef850>
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_da0a52acd5f90d58280483c34486c44d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_da0a52acd5f90d58280483c34486c44d.jpg saved to cache
2025-12-05 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_216c57cb4d3b0882cd76c78349c84b18.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a22090>
2025-12-05 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_605bae3718af7e31d1b683f1d1b11061.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_605bae3718af7e31d1b683f1d1b11061.jpg saved to cache
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbd1d0>
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_1622c09ea418f3b4fef48f860b017a1d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_1622c09ea418f3b4fef48f860b017a1d.jpg saved to cache
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb3fd0>
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_cb143032af0ce56f97582e4c2110b2ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_cb143032af0ce56f97582e4c2110b2ba.jpg saved to cache
2025-12-05 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57dda90>
2025-12-05 17:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_9a3c43d8a09cff72b45ba78c0ffb9239.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_9a3c43d8a09cff72b45ba78c0ffb9239.jpg saved to cache
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f3950>
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_c9cbe14d2ba659a0d1939a904bb9373c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_c9cbe14d2ba659a0d1939a904bb9373c.jpg saved to cache
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf06d0>
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_551f9b1592e3ee7ada6892847d415d0f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_551f9b1592e3ee7ada6892847d415d0f.jpg saved to cache
2025-12-05 17:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_d287f451785ae8f67c84ee6c8da8eef7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e49490>
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_216c57cb4d3b0882cd76c78349c84b18.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_216c57cb4d3b0882cd76c78349c84b18.jpg saved to cache
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579e290>
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_d287f451785ae8f67c84ee6c8da8eef7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_d287f451785ae8f67c84ee6c8da8eef7.jpg saved to cache
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_29b5d71a528c79090977a2b900a9fdb3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_23b1d01f715bde98fcbdd002a26180fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_1db6a5f4a8e5e45704699c182395aff3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d77f10>
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_29b5d71a528c79090977a2b900a9fdb3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_29b5d71a528c79090977a2b900a9fdb3.jpg saved to cache
2025-12-05 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_71ac5992f730a75749249334ca2d5c6f.png> (referer: https://www.auto1.com/)
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e228d0>
2025-12-05 17:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_23b1d01f715bde98fcbdd002a26180fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_23b1d01f715bde98fcbdd002a26180fa.jpg saved to cache
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e635b426a03d01219eaaa6b03d04c37f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_10fbd33b91cce9b20def7d0f7bb0021b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_b9437979e33f5889e791ffe9b462bf2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d62510>
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_1db6a5f4a8e5e45704699c182395aff3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_1db6a5f4a8e5e45704699c182395aff3.jpg saved to cache
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_a390c29f94e212e88576389e360ccc5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:05:18 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:05:18 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:05:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c78f10>
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_15.png HTTP/1.1" 201 0
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_71ac5992f730a75749249334ca2d5c6f.png') HTTP/1.1" 204 0
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_71ac5992f730a75749249334ca2d5c6f.png saved to cache
2025-12-05 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591b650>
2025-12-05 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_e635b426a03d01219eaaa6b03d04c37f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e635b426a03d01219eaaa6b03d04c37f.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:19 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:05:19 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:05:19 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:05:19 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c99b50>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_15.png HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_86b3c737b4f91f40e926e403800be700.png') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a94d50>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_10fbd33b91cce9b20def7d0f7bb0021b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_10fbd33b91cce9b20def7d0f7bb0021b.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591ad50>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_b9437979e33f5889e791ffe9b462bf2f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_b9437979e33f5889e791ffe9b462bf2f.jpg saved to cache
2025-12-05 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5296c6b97ce12aeee684dbebb7566037.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c9050>
2025-12-05 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_a390c29f94e212e88576389e360ccc5c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_a390c29f94e212e88576389e360ccc5c.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_5213fbd07c83ab452f8dcc4bc12519d8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_0620eb7366abd8f9cbfc6597995013fb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c590a790>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_5296c6b97ce12aeee684dbebb7566037.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5296c6b97ce12aeee684dbebb7566037.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b2250>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3f290>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_fc1f81767b8fce22fc56bce197e87730.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg saved to cache
2025-12-05 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_3575fff8ceca3c7ca7421a1019c700a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_74b837ad5400c3576508ffb97ec64382.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_4e57f4ac9818bae1e3f3e461e2e5a626.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c590a190>
2025-12-05 17:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a221d0>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_5213fbd07c83ab452f8dcc4bc12519d8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_5213fbd07c83ab452f8dcc4bc12519d8.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7ba90>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_0620eb7366abd8f9cbfc6597995013fb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_0620eb7366abd8f9cbfc6597995013fb.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_4cadfe1413a65c0a1b9c5d0bc59f5bdf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_fb9d1e20f3c20e230f08a5eb46a78906.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_a16eed5bc2e5de90db1b388f0be66faf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ed5d0>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_3575fff8ceca3c7ca7421a1019c700a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_3575fff8ceca3c7ca7421a1019c700a6.jpg saved to cache
2025-12-05 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e20dd0>
2025-12-05 17:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_74b837ad5400c3576508ffb97ec64382.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_74b837ad5400c3576508ffb97ec64382.jpg saved to cache
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f08d0>
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_4e57f4ac9818bae1e3f3e461e2e5a626.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_4e57f4ac9818bae1e3f3e461e2e5a626.jpg saved to cache
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a8a650>
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_3016e47f92e721458b228c22409aa3de.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg saved to cache
2025-12-05 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_c588d57a9c8f02aeea4f07611fe21700.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_45370913a35b6e46a203999b5b9a5d9f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_852b95849d1e3a6f53b906fa54328f24.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_5544783b4ec7960b767fe7799a7c5b45.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b26bd0>
2025-12-05 17:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4c%252F964cdcb5356bdc6ec051b160e60b2ed7%252Fpa%252FTB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg saved to cache
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c
2025-12-05 17:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b177e63-b499-5b2a-8a5f-a8cd4435635c, skipping ID generation
2025-12-05 17:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c with scrape type 1
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0b177e63-b499-5b2a-8a5f-a8cd4435635c from tracking dictionaries
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b177e63-b499-5b2a-8a5f-a8cd4435635c sending to next pipeline
2025-12-05 17:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0b177e63-b499-5b2a-8a5f-a8cd4435635c, identifier: TB81364
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c9110>
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_4cadfe1413a65c0a1b9c5d0bc59f5bdf.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_4cadfe1413a65c0a1b9c5d0bc59f5bdf.jpg saved to cache
2025-12-05 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591a8d0>
2025-12-05 17:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_fb9d1e20f3c20e230f08a5eb46a78906.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_fb9d1e20f3c20e230f08a5eb46a78906.jpg saved to cache
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e23810>
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F74%252F7374dba3232f09edcd8dd590be354742%252Fpa%252FBJ78204_a16eed5bc2e5de90db1b388f0be66faf.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_a16eed5bc2e5de90db1b388f0be66faf.jpg saved to cache
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 322f8fdf-9af6-54da-9d60-e30e4f859261
2025-12-05 17:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 322f8fdf-9af6-54da-9d60-e30e4f859261, skipping ID generation
2025-12-05 17:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322f8fdf-9af6-54da-9d60-e30e4f859261 with scrape type 1
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 322f8fdf-9af6-54da-9d60-e30e4f859261 from tracking dictionaries
2025-12-05 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 322f8fdf-9af6-54da-9d60-e30e4f859261 sending to next pipeline
2025-12-05 17:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 322f8fdf-9af6-54da-9d60-e30e4f859261, identifier: BJ78204
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_919068692aeeefe28f6c0d20df1392e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_14f8a53228094b3df4f9f840602f9c2a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0b177e63-b499-5b2a-8a5f-a8cd4435635c with identifier: TB81364
2025-12-05 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0b177e63-b499-5b2a-8a5f-a8cd4435635c with identifier: TB81364
2025-12-05 17:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0b177e63-b499-5b2a-8a5f-a8cd4435635c with identifier: TB81364 to the API
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 43,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 245,
'expiration_date': '2025-12-06T16:48:44Z',
'fuel_type': 'hybrid',
'id': '0b177e63-b499-5b2a-8a5f-a8cd4435635c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB81364',
'listing': 'auction',
'location': 'FR, Saint-Avé',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 66704,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_a390c29f94e212e88576389e360ccc5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_b9437979e33f5889e791ffe9b462bf2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2769128,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_4e57f4ac9818bae1e3f3e461e2e5a626.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_559ad3421460f04ca2021822f6aba43b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2614070,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_d2ae7f7aeabf140419fd3e7bc4e8a3eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_da0a52acd5f90d58280483c34486c44d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_874d7da8d7c8d61763641abe62365426.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_9a3c43d8a09cff72b45ba78c0ffb9239.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_551f9b1592e3ee7ada6892847d415d0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_1622c09ea418f3b4fef48f860b017a1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_c9cbe14d2ba659a0d1939a904bb9373c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_23b1d01f715bde98fcbdd002a26180fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_605bae3718af7e31d1b683f1d1b11061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2488416,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_0620eb7366abd8f9cbfc6597995013fb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_10fbd33b91cce9b20def7d0f7bb0021b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b177e63-b499-5b2a-8a5f-a8cd4435635c/0b177e63-b499-5b2a-8a5f-a8cd4435635c_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 81047,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img96/4c/964cdcb5356bdc6ec051b160e60b2ed7/pa/TB81364_71ac5992f730a75749249334ca2d5c6f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB81364%27 HTTP/1.1" 200 None
2025-12-05 17:05:24 [auto1.fr] INFO: Saving data for TB81364: {'created_time': 1764954324.849399, 'last_price_update_time': 1764954324.849408, 'auction_closing_time': 1765039724.0}
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB81364') HTTP/1.1" 204 0
2025-12-05 17:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 322f8fdf-9af6-54da-9d60-e30e4f859261 with identifier: BJ78204
2025-12-05 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 322f8fdf-9af6-54da-9d60-e30e4f859261 with identifier: BJ78204
2025-12-05 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147193 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
147193
2025-12-05 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 322f8fdf-9af6-54da-9d60-e30e4f859261 spider: auto1.fr
2025-12-05 17:05:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 322f8fdf-9af6-54da-9d60-e30e4f859261 due to rule: high_mileage_for_make.json, error: 147193 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
147193
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:08:12Z',
'fuel_type': 'petrol',
'id': '322f8fdf-9af6-54da-9d60-e30e4f859261',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ78204',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Megane',
'odometer': 147193,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_a16eed5bc2e5de90db1b388f0be66faf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_befbb1ce24af599d265d1e0eae30f339.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_44e0ebff165dbc89d7673ee45d6551b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_65a5304b67648a40097de9935974b7bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322f8fdf-9af6-54da-9d60-e30e4f859261/322f8fdf-9af6-54da-9d60-e30e4f859261_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img73/74/7374dba3232f09edcd8dd590be354742/pa/BJ78204_ee680c1029d5ee350ff1311b1d86a444.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Edition One',
'transmission': 'automatic',
'trim': 'Edition One',
'year': 2021}
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ78204%27 HTTP/1.1" 200 None
2025-12-05 17:05:25 [auto1.fr] INFO: Saving data for BJ78204: {'created_time': 1764954325.056448, 'last_price_update_time': 1764954325.056458, 'auction_closing_time': 1765037292.0}
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BJ78204') HTTP/1.1" 204 0
2025-12-05 17:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d85264e6e2742de2062154184240e466.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f05e50>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fd8%252Fa5d8d207557a63c95179c7d5aa3a44a3%252Fpa%252FZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg saved to cache
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f69cfdc1-c1eb-5129-b148-9d75696d7efb
2025-12-05 17:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f69cfdc1-c1eb-5129-b148-9d75696d7efb, skipping ID generation
2025-12-05 17:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69cfdc1-c1eb-5129-b148-9d75696d7efb with scrape type 1
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f69cfdc1-c1eb-5129-b148-9d75696d7efb from tracking dictionaries
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f69cfdc1-c1eb-5129-b148-9d75696d7efb sending to next pipeline
2025-12-05 17:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f69cfdc1-c1eb-5129-b148-9d75696d7efb, identifier: ZT50667
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf6350>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_c588d57a9c8f02aeea4f07611fe21700.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_c588d57a9c8f02aeea4f07611fe21700.jpg saved to cache
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dad150>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Ff7%252F2ff7d9b8b347203fb90fbbf9d3245961%252Fpa%252FKH23745_45370913a35b6e46a203999b5b9a5d9f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_45370913a35b6e46a203999b5b9a5d9f.jpg saved to cache
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669
2025-12-05 17:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ac78fb2-52e2-52cf-a36f-988d2ac18669, skipping ID generation
2025-12-05 17:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669 with scrape type 1
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7ac78fb2-52e2-52cf-a36f-988d2ac18669 from tracking dictionaries
2025-12-05 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ac78fb2-52e2-52cf-a36f-988d2ac18669 sending to next pipeline
2025-12-05 17:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ac78fb2-52e2-52cf-a36f-988d2ac18669, identifier: KH23745
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59084d0>
2025-12-05 17:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_852b95849d1e3a6f53b906fa54328f24.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_852b95849d1e3a6f53b906fa54328f24.jpg saved to cache
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf7e50>
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_5544783b4ec7960b767fe7799a7c5b45.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_5544783b4ec7960b767fe7799a7c5b45.jpg saved to cache
2025-12-05 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f69cfdc1-c1eb-5129-b148-9d75696d7efb with identifier: ZT50667
2025-12-05 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f69cfdc1-c1eb-5129-b148-9d75696d7efb with identifier: ZT50667
2025-12-05 17:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f69cfdc1-c1eb-5129-b148-9d75696d7efb with identifier: ZT50667 to the API
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2025-12-06T16:06:46Z',
'fuel_type': 'diesel',
'id': 'f69cfdc1-c1eb-5129-b148-9d75696d7efb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT50667',
'listing': 'auction',
'location': 'FR',
'make': 'BMW',
'model': 'X3',
'odometer': 50202,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_3f3f82e694166e85e7d2467eab67f360.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_2bd242f9dae028a8dddc849baca4072d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f2247e4e8904b431b015c02f8ef502b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_4cadfe1413a65c0a1b9c5d0bc59f5bdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_362e07d42edb0902d3f37f4610a23931.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_ba8a7db3077fd9c3c26743a152afe2f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5bd905d3dfce4c302f8afe3084b63fb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_bbbb2c9841284231d942abaa3fdbff5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_74b837ad5400c3576508ffb97ec64382.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_d4c8ec5c9b765a4380bab7239f0c3760.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_133f1e8c390ee2e6c1d1eb01911c9b88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_b6d14728d55e1be80da4337c82a30a61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_1fa16f98b0af84eea3bf1a6396aa346b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_960f3f062d30f3e156b185f0fc0471b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_f6554e7fe62e9b3c99f63473517f996c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_0f67d759468d9dc0b17b58b08101cb12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25647,
'Height': 484,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_25c700c5800a368ef3777f9d8a382878.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27144,
'Height': 426,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_444d1e3b93009bfbfb8c32fde8096ca8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 17092,
'Height': 282,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_815af4ab1fc8a9707551e3ebfb476820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69cfdc1-c1eb-5129-b148-9d75696d7efb/f69cfdc1-c1eb-5129-b148-9d75696d7efb_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 16936,
'Height': 323,
'OriginUrl': 'https://img-pa.auto1.com/imga5/d8/a5d8d207557a63c95179c7d5aa3a44a3/pa/ZT50667_5296c6b97ce12aeee684dbebb7566037.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT50667%27 HTTP/1.1" 200 None
2025-12-05 17:05:26 [auto1.fr] INFO: Saving data for ZT50667: {'created_time': 1764954326.715917, 'last_price_update_time': 1764954326.715927, 'auction_closing_time': 1765037206.0}
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZT50667') HTTP/1.1" 204 0
2025-12-05 17:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ac78fb2-52e2-52cf-a36f-988d2ac18669 with identifier: KH23745
2025-12-05 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ac78fb2-52e2-52cf-a36f-988d2ac18669 with identifier: KH23745
2025-12-05 17:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ac78fb2-52e2-52cf-a36f-988d2ac18669 with identifier: KH23745 to the API
2025-12-05 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_45370913a35b6e46a203999b5b9a5d9f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2025-12-06T16:32:12Z',
'fuel_type': 'hybrid',
'id': '7ac78fb2-52e2-52cf-a36f-988d2ac18669',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH23745',
'listing': 'auction',
'location': 'FR, Laval',
'make': 'Renault',
'model': 'Captur',
'odometer': 53437,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a77d1e6e45290e03a5c5a924fffcb96d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5f5d52362a953fe9286d5764ea48d826.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_57b4b74f571c8b20dce1d5fdbfc50f18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5323fa56388fc563bb09c53c377cab83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_45370913a35b6e46a203999b5b9a5d9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_5da809e6ea89b9d4db0897be7fb42fa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_89e9df8c8b038bebdfbc1ffc4b5550eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_cabdd5a12fd2ab957e7d702a1aae253e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_9d6dcd892902ae520b176d02301aafee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_881527179e146762be465bfaec4a7d77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_c588d57a9c8f02aeea4f07611fe21700.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_fb9d1e20f3c20e230f08a5eb46a78906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_3575fff8ceca3c7ca7421a1019c700a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_a2b92814281b3e08301599e226ebbe49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_29a79ec90ae0658f2abb33595aaccd96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac78fb2-52e2-52cf-a36f-988d2ac18669/7ac78fb2-52e2-52cf-a36f-988d2ac18669_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/f7/2ff7d9b8b347203fb90fbbf9d3245961/pa/KH23745_d5c8c808597d3d69bee85ddc8cdd3220.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2021}
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH23745%27 HTTP/1.1" 200 None
2025-12-05 17:05:27 [auto1.fr] INFO: Saving data for KH23745: {'created_time': 1764954327.122039, 'last_price_update_time': 1764954327.12205, 'auction_closing_time': 1765038732.0}
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH23745') HTTP/1.1" 204 0
2025-12-05 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c40d10>
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_919068692aeeefe28f6c0d20df1392e4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_919068692aeeefe28f6c0d20df1392e4.jpg saved to cache
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1d050>
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_14f8a53228094b3df4f9f840602f9c2a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_14f8a53228094b3df4f9f840602f9c2a.jpg saved to cache
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d91c3cd910de81a84868a9618990246c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583c4d0>
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_d85264e6e2742de2062154184240e466.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d85264e6e2742de2062154184240e466.jpg saved to cache
2025-12-05 17:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a867d0>
2025-12-05 17:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4efe650>
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_d91c3cd910de81a84868a9618990246c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d91c3cd910de81a84868a9618990246c.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a5e2eb5284c471a86c417d7b757c8f32.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbaf50>
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_695f32fd62f78f850bafc4f4ba17747d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da2490>
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_a5e2eb5284c471a86c417d7b757c8f32.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a5e2eb5284c471a86c417d7b757c8f32.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a96610>
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg saved to cache
2025-12-05 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3f138e31ae870d0f89e8a7b522fa3776.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_78b40f03a0888d6bbfc4114da2b7b621.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_64f219bf1f218b8da13d0c300e7bd986.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_0af21e4f4a4887911b6918c36b273c58.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8d91fb1d23a62c266e21fccdfccc79fb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_552317ec6606c203ad0c4946ea97c23d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_17f52869f8c1d39499f771b25ee305b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a73d10>
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_3f138e31ae870d0f89e8a7b522fa3776.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3f138e31ae870d0f89e8a7b522fa3776.jpg saved to cache
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cacd90>
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_78b40f03a0888d6bbfc4114da2b7b621.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_78b40f03a0888d6bbfc4114da2b7b621.jpg saved to cache
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb1a90>
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F5a%252F0a5acc09d73ad079ec0ccd461fb68e37%252Fpa%252FKX17543_64f219bf1f218b8da13d0c300e7bd986.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_64f219bf1f218b8da13d0c300e7bd986.jpg saved to cache
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37
2025-12-05 17:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7c7d46c-2064-5c0b-bff0-c4fc67a70c37, skipping ID generation
2025-12-05 17:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 with scrape type 1
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 from tracking dictionaries
2025-12-05 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 sending to next pipeline
2025-12-05 17:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c7c7d46c-2064-5c0b-bff0-c4fc67a70c37, identifier: KX17543
2025-12-05 17:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e32950>
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F99%252F639930e149b648340fc0899c72e895d4%252Fpa%252FWZ78680_d4d309a22b19002047c3c8946c1c0409.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg saved to cache
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d57f431b-a53a-58a2-a578-d11f001a0151
2025-12-05 17:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d57f431b-a53a-58a2-a578-d11f001a0151, skipping ID generation
2025-12-05 17:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d57f431b-a53a-58a2-a578-d11f001a0151 with scrape type 1
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d57f431b-a53a-58a2-a578-d11f001a0151 from tracking dictionaries
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d57f431b-a53a-58a2-a578-d11f001a0151 sending to next pipeline
2025-12-05 17:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d57f431b-a53a-58a2-a578-d11f001a0151, identifier: WZ78680
2025-12-05 17:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583e710>
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_0af21e4f4a4887911b6918c36b273c58.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_0af21e4f4a4887911b6918c36b273c58.jpg saved to cache
2025-12-05 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c588c8d0>
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_8d91fb1d23a62c266e21fccdfccc79fb.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8d91fb1d23a62c266e21fccdfccc79fb.jpg saved to cache
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da2490>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_552317ec6606c203ad0c4946ea97c23d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_552317ec6606c203ad0c4946ea97c23d.jpg saved to cache
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a73d10>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F60%252F256000f20000e2e9bec3c25f851ceba2%252Fpa%252FES57929_17f52869f8c1d39499f771b25ee305b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_17f52869f8c1d39499f771b25ee305b5.jpg saved to cache
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd
2025-12-05 17:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b87cfcd-abad-5cb6-9458-c2fc901a41bd, skipping ID generation
2025-12-05 17:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd with scrape type 1
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd from tracking dictionaries
2025-12-05 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b87cfcd-abad-5cb6-9458-c2fc901a41bd sending to next pipeline
2025-12-05 17:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0b87cfcd-abad-5cb6-9458-c2fc901a41bd, identifier: ES57929
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d3750>
2025-12-05 17:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg saved to cache
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5926350>
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_be9532b4626d8caa881adfa6a61ca2be.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg saved to cache
2025-12-05 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 with identifier: KX17543
2025-12-05 17:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 with identifier: KX17543
2025-12-05 17:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c7c7d46c-2064-5c0b-bff0-c4fc67a70c37 with identifier: KX17543 to the API
2025-12-05 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_64f219bf1f218b8da13d0c300e7bd986.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:46:51Z',
'fuel_type': 'gas',
'id': 'c7c7d46c-2064-5c0b-bff0-c4fc67a70c37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX17543',
'listing': 'auction',
'location': 'FR, Seclin',
'make': 'Dacia',
'model': 'Duster',
'odometer': 13560,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e91126a8c9e5497a6d3c78dd2cb09643.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3123409,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_cb143032af0ce56f97582e4c2110b2ba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_dcc0936e78da36197ac27ee26c1dcf86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_f82e8f83c1948e1ef1469eb0cd4c641a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2853603,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_216c57cb4d3b0882cd76c78349c84b18.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_8504bfed9934975147556187ac5b9c86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2898578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_d287f451785ae8f67c84ee6c8da8eef7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_5213fbd07c83ab452f8dcc4bc12519d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_68fcf0a9b47518f4ded02f16b60d17af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3009981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_64f219bf1f218b8da13d0c300e7bd986.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_de43b672a970c9132ae9cdd412430a03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_0d8284365f7629628ce0bce274d9ff05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e635b426a03d01219eaaa6b03d04c37f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2680872,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_1db6a5f4a8e5e45704699c182395aff3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_e7a1da68186cf0a989c2b335b1d7555d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7c7d46c-2064-5c0b-bff0-c4fc67a70c37/c7c7d46c-2064-5c0b-bff0-c4fc67a70c37_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/5a/0a5acc09d73ad079ec0ccd461fb68e37/pa/KX17543_29b5d71a528c79090977a2b900a9fdb3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-05',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Journey Go',
'transmission': 'manual',
'trim': 'Journey Go',
'year': 2023}
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX17543%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [auto1.fr] INFO: Saving data for KX17543: {'created_time': 1764954333.382462, 'last_price_update_time': 1764954333.382471, 'auction_closing_time': 1765039611.0}
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX17543') HTTP/1.1" 204 0
2025-12-05 17:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d57f431b-a53a-58a2-a578-d11f001a0151 with identifier: WZ78680
2025-12-05 17:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d57f431b-a53a-58a2-a578-d11f001a0151 with identifier: WZ78680
2025-12-05 17:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault grand scenic 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'grand scenic', 'transmission': 'manual', 'odometer': 22506, 'odometer_reading_unit': 'km', 'registration_date': '2017-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wz78680', 'expiration_date': '2025-12-06t16:17:20z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 132, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, toulouse', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': 'd57f431b-a53a-58a2-a578-d11f001a0151', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74404}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2424790}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2590484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2478008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2614138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71088}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70801}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76737}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74090}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63286}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66924}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 82536}], 'current_year_diff': 8, 'age_in_months': 99, 'make_model': 'renault grand scenic', 'sanitized_make': 'renault', 'odometer_in_km': 22506}
Failed validating None in schema:
False
On instance:
{'age_in_months': 99,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 132,
'expiration_date': '2025-12-06t16:17:20z',
'fuel_type': 'petrol',
'id': 'd57f431b-a53a-58a2-a578-d11f001a0151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wz78680',
'listing': 'auction',
'location': 'fr, toulouse',
'make': 'renault',
'make_model': 'renault grand scenic',
'model': 'grand scenic',
'odometer': 22506,
'odometer_in_km': 22506,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2424790,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2590484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2614138,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82536,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-30',
'sanitized_make': 'renault',
'seats_number': 7,
'seller_name': None,
'title': 'renault grand scenic 1.2 tce energy intens',
'transmission': 'manual',
'trim': 'intens',
'year': 2017}
2025-12-05 17:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: d57f431b-a53a-58a2-a578-d11f001a0151 spider: auto1.fr
2025-12-05 17:05:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d57f431b-a53a-58a2-a578-d11f001a0151 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault grand scenic 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'grand scenic', 'transmission': 'manual', 'odometer': 22506, 'odometer_reading_unit': 'km', 'registration_date': '2017-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wz78680', 'expiration_date': '2025-12-06t16:17:20z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 132, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, toulouse', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': 'd57f431b-a53a-58a2-a578-d11f001a0151', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74404}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2424790}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2590484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2478008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2614138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71088}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70801}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76737}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74090}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63286}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66924}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 82536}], 'current_year_diff': 8, 'age_in_months': 99, 'make_model': 'renault grand scenic', 'sanitized_make': 'renault', 'odometer_in_km': 22506}
Failed validating None in schema:
False
On instance:
{'age_in_months': 99,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 132,
'expiration_date': '2025-12-06t16:17:20z',
'fuel_type': 'petrol',
'id': 'd57f431b-a53a-58a2-a578-d11f001a0151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wz78680',
'listing': 'auction',
'location': 'fr, toulouse',
'make': 'renault',
'make_model': 'renault grand scenic',
'model': 'grand scenic',
'odometer': 22506,
'odometer_in_km': 22506,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2424790,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2590484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2614138,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82536,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-30',
'sanitized_make': 'renault',
'seats_number': 7,
'seller_name': None,
'title': 'renault grand scenic 1.2 tce energy intens',
'transmission': 'manual',
'trim': 'intens',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 132,
'expiration_date': '2025-12-06T16:17:20Z',
'fuel_type': 'petrol',
'id': 'd57f431b-a53a-58a2-a578-d11f001a0151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ78680',
'listing': 'auction',
'location': 'FR, Toulouse',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 22506,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_4e4e53ae2d3cd1d7caacb2c434938251.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7cc3d2f8a6521b4c4db52b94c6c818b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2424790,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_2f78207da34c0feed26a5cc024364935.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_3016e47f92e721458b228c22409aa3de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2590484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_6aac450712ec9d0c948692e5fe832791.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_49a2922121bed67bec60d208ca6b06ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_f1f7e602f62fb41b2b2996689bc38f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2614138,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_d4d309a22b19002047c3c8946c1c0409.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_538e2a6587cc59d7dfe3acd362b46655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_c3e820800b8b50339752e406b16951ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_8ccdad80ef69259e3c6913dc1d421d3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_a6aa3b487d5a07fa8aa345a29dd5d953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_9905e7b1533ca415bd787a865453b4c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_fc1f81767b8fce22fc56bce197e87730.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_7ec9ccdd522381e30468fbbf9882e68e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57f431b-a53a-58a2-a578-d11f001a0151/d57f431b-a53a-58a2-a578-d11f001a0151_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82536,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img63/99/639930e149b648340fc0899c72e895d4/pa/WZ78680_86b3c737b4f91f40e926e403800be700.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-30',
'seats_number': 7,
'seller_name': None,
'title': 'Renault Grand Scenic 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ78680%27 HTTP/1.1" 200 None
2025-12-05 17:05:33 [auto1.fr] INFO: Saving data for WZ78680: {'created_time': 1764954333.644091, 'last_price_update_time': 1764954333.6441, 'auction_closing_time': 1765037840.0}
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WZ78680') HTTP/1.1" 204 0
2025-12-05 17:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0b87cfcd-abad-5cb6-9458-c2fc901a41bd with identifier: ES57929
2025-12-05 17:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0b87cfcd-abad-5cb6-9458-c2fc901a41bd with identifier: ES57929
2025-12-05 17:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0b87cfcd-abad-5cb6-9458-c2fc901a41bd with identifier: ES57929 to the API
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_17f52869f8c1d39499f771b25ee305b5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2025-12-06T16:10:33Z',
'fuel_type': 'petrol',
'id': '0b87cfcd-abad-5cb6-9458-c2fc901a41bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES57929',
'listing': 'auction',
'location': 'FR, Metz',
'make': 'Ford',
'model': 'B-Max',
'odometer': 83809,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_514016b238e1ac78dd0a075a5b5f4b0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3074738,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_4451a8ba4834808654fd1cc6b60759ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a9b7c0aaad8680a9dce12138390abde1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d8d898460ec5bca14a6ad7f2e866738a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3107814,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8c3b089b6e0f14f9a8666c0481546fd4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_a0ac4206087712561311c1b2292ea2ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_919068692aeeefe28f6c0d20df1392e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2864454,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_552317ec6606c203ad0c4946ea97c23d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3110753,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_17f52869f8c1d39499f771b25ee305b5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_7b75fb281c78845945baa0b348bc506d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_14f8a53228094b3df4f9f840602f9c2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_ceea9509b357667cf26fc48fd20df039.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_d85264e6e2742de2062154184240e466.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2674586,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_8d91fb1d23a62c266e21fccdfccc79fb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_5544783b4ec7960b767fe7799a7c5b45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b87cfcd-abad-5cb6-9458-c2fc901a41bd/0b87cfcd-abad-5cb6-9458-c2fc901a41bd_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/60/256000f20000e2e9bec3c25f851ceba2/pa/ES57929_852b95849d1e3a6f53b906fa54328f24.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2025-12-05 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES57929%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [auto1.fr] INFO: Saving data for ES57929: {'created_time': 1764954334.007618, 'last_price_update_time': 1764954334.007627, 'auction_closing_time': 1765037433.0}
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ES57929') HTTP/1.1" 204 0
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA89800/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59178d0>
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fb4%252Fd7b43798cc2656f292f0eade19a481e9%252Fpa%252FND23721_ffa73b95d262eadaf288351a2282152e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg saved to cache
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3eebf1b-5830-5971-953e-f8e30e39f029
2025-12-05 17:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3eebf1b-5830-5971-953e-f8e30e39f029, skipping ID generation
2025-12-05 17:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3eebf1b-5830-5971-953e-f8e30e39f029 with scrape type 1
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d3eebf1b-5830-5971-953e-f8e30e39f029 from tracking dictionaries
2025-12-05 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3eebf1b-5830-5971-953e-f8e30e39f029 sending to next pipeline
2025-12-05 17:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3eebf1b-5830-5971-953e-f8e30e39f029, identifier: ND23721
2025-12-05 17:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3eebf1b-5830-5971-953e-f8e30e39f029 with identifier: ND23721
2025-12-05 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3eebf1b-5830-5971-953e-f8e30e39f029 with identifier: ND23721
2025-12-05 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 22, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 112710, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nd23721', 'expiration_date': '2025-12-06t16:48:23z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'd3eebf1b-5830-5971-953e-f8e30e39f029', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89846}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 96749}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79126}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91452}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83513}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 102729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 36545}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61483}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 44674}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53457}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81551}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20973}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20631}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg', 'Width': 800, 'Height': 360, 'Extension': 'jpg', 'FileSizeInBytes': 23359}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg', 'Width': 800, 'Height': 360, 'Extension': 'jpg', 'FileSizeInBytes': 18236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62145}], 'current_year_diff': 8, 'age_in_months': 106, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 112710}
Failed validating None in schema:
False
On instance:
{'age_in_months': 106,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:48:23z',
'fuel_type': 'petrol',
'id': 'd3eebf1b-5830-5971-953e-f8e30e39f029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nd23721',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 112710,
'odometer_in_km': 112710,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23359,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18236,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-25',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2017}
2025-12-05 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d3eebf1b-5830-5971-953e-f8e30e39f029 spider: auto1.fr
2025-12-05 17:05:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d3eebf1b-5830-5971-953e-f8e30e39f029 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 22, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 112710, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nd23721', 'expiration_date': '2025-12-06t16:48:23z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'd3eebf1b-5830-5971-953e-f8e30e39f029', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89846}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 96749}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79126}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91452}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83513}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 102729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 36545}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61483}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 44674}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53457}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81551}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20973}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20631}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg', 'Width': 800, 'Height': 360, 'Extension': 'jpg', 'FileSizeInBytes': 23359}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg', 'Width': 800, 'Height': 360, 'Extension': 'jpg', 'FileSizeInBytes': 18236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62145}], 'current_year_diff': 8, 'age_in_months': 106, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 112710}
Failed validating None in schema:
False
On instance:
{'age_in_months': 106,
'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:48:23z',
'fuel_type': 'petrol',
'id': 'd3eebf1b-5830-5971-953e-f8e30e39f029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nd23721',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 112710,
'odometer_in_km': 112710,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23359,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18236,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-25',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:48:23Z',
'fuel_type': 'petrol',
'id': 'd3eebf1b-5830-5971-953e-f8e30e39f029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND23721',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 112710,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_bd7096c6de6991ea2f0c0283fb8d19d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_575233283950e0c541525d715d31bde8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_db38b9042782e0db25ba0904ca19ff59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_80c2e478f538c4894039a040c6d2cc82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ffa73b95d262eadaf288351a2282152e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_2b70ffb89225fc54d4d832592745941c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_be9532b4626d8caa881adfa6a61ca2be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6fa5ef510dc491a693c6e65ee90339c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_8fcaca92cffd50bac7b998e83c0dc5f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_fd5d08a53833f8dc98427dc6005ab55e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_695f32fd62f78f850bafc4f4ba17747d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_ea47ea45381c32fa040d65664ba7478e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a51ab6a8a90897ad6c13e502e1a030ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_67e68e31488cdeac6c74d592e247587d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_4cb22c6373024e9379897c506ffb2364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_a9a7892fbeac36dd89c2fa86bba3b5a4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_6b2632f7e7766dbf4ae99372a6cf984f.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23359,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_735bf8616ba1e512fb0fe3b3a7dcbc05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18236,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_eea9ca5449618883c92df126b009011a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3eebf1b-5830-5971-953e-f8e30e39f029/d3eebf1b-5830-5971-953e-f8e30e39f029_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/b4/d7b43798cc2656f292f0eade19a481e9/pa/ND23721_d0795dd8c49fa7e632d163a54ad924ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2017}
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND23721%27 HTTP/1.1" 200 None
2025-12-05 17:05:34 [auto1.fr] INFO: Saving data for ND23721: {'created_time': 1764954334.617266, 'last_price_update_time': 1764954334.617275, 'auction_closing_time': 1765039703.0}
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ND23721') HTTP/1.1" 204 0
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC77266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbbb50>
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg saved to cache
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594fd10>
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F06%252Ff406908a0bafa4fe013eca1b04290ff1%252Fpa%252FJY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg saved to cache
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 211ecd27-7f9f-5f3f-b75a-708456b83dec
2025-12-05 17:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 211ecd27-7f9f-5f3f-b75a-708456b83dec, skipping ID generation
2025-12-05 17:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211ecd27-7f9f-5f3f-b75a-708456b83dec with scrape type 1
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 211ecd27-7f9f-5f3f-b75a-708456b83dec from tracking dictionaries
2025-12-05 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 211ecd27-7f9f-5f3f-b75a-708456b83dec sending to next pipeline
2025-12-05 17:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 211ecd27-7f9f-5f3f-b75a-708456b83dec, identifier: JY96879
2025-12-05 17:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 211ecd27-7f9f-5f3f-b75a-708456b83dec with identifier: JY96879
2025-12-05 17:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 211ecd27-7f9f-5f3f-b75a-708456b83dec with identifier: JY96879
2025-12-05 17:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 211ecd27-7f9f-5f3f-b75a-708456b83dec with identifier: JY96879 to the API
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.5L',
'engine_horse_power': 313,
'expiration_date': '2025-12-06T16:45:10Z',
'fuel_type': 'hybrid',
'id': '211ecd27-7f9f-5f3f-b75a-708456b83dec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY96879',
'listing': 'auction',
'location': 'FR, Wambrechies',
'make': 'Lexus',
'model': 'RX-Serie',
'odometer': 76305,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2627958,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_76f9a02991fd80d5dff1b5e768bd2806.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2652898,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a535556b0b1d0ee70a689d0a7a7ad15a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2547047,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_8f9c3356417e5aaa7b0e72738d17fbff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3f138e31ae870d0f89e8a7b522fa3776.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_78b40f03a0888d6bbfc4114da2b7b621.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_a5e2eb5284c471a86c417d7b757c8f32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1974975,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_0af21e4f4a4887911b6918c36b273c58.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d91c3cd910de81a84868a9618990246c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669856,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fd79b0fa9298b398b235ab4a77f4f216.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2094668,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_422b19ee029af83d9d66eecb78accbcf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510613,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_1bd8bd764e267b415112f221bbd41fd6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397238,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_3c902c136941607040d9b871b8a7301d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_835c73d5eee87701dfc01aa4879c403a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_fbf9f8ef87ebf73a6eb8aaca8706c82e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_f6b4e0f42b1baa595050c0bf4d1163aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_211ecd27-7f9f-5f3f-b75a-708456b83dec/211ecd27-7f9f-5f3f-b75a-708456b83dec_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71726,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/06/f406908a0bafa4fe013eca1b04290ff1/pa/JY96879_d37d703f980174f884b3f34d0a8fd9f2.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus RX-Serie RX 450h F SPORT AWD',
'transmission': 'automatic',
'trim': 'F SPORT AWD',
'year': 2019}
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY96879%27 HTTP/1.1" 200 None
2025-12-05 17:05:35 [auto1.fr] INFO: Saving data for JY96879: {'created_time': 1764954335.921547, 'last_price_update_time': 1764954335.921557, 'auction_closing_time': 1765039510.0}
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY96879') HTTP/1.1" 204 0
2025-12-05 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM00106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb1250>
2025-12-05 17:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_639b5db7a017ec61a6a728d629c49e60.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd5a90>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_9db263a0fb208381de62f748934c19d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5882b90>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_4d72d4a2025568083cad55e0c1eada98.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg saved to cache
2025-12-05 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b6f10>
2025-12-05 17:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg saved to cache
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS56768> (referer: https://www.auto1.com/v1/car-details-view/KS56768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN63847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC79503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM61859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH76441> (referer: https://www.auto1.com/v1/car-details-view/RH76441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA89800> (referer: https://www.auto1.com/v1/car-details-view/ZA89800/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX05561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7da4cb79430c830eb8f679686121c0a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba0ad4cb-6cc6-50a3-8092-6c86152782ee with identifier: KS56768
2025-12-05 17:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba0ad4cb-6cc6-50a3-8092-6c86152782ee with scrape type 2
2025-12-05 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba0ad4cb-6cc6-50a3-8092-6c86152782ee with scrape type 2
2025-12-05 17:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ba0ad4cb-6cc6-50a3-8092-6c86152782ee, identifier: KS56768
2025-12-05 17:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ba0ad4cb-6cc6-50a3-8092-6c86152782ee with identifier: KS56768
2025-12-05 17:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ba0ad4cb-6cc6-50a3-8092-6c86152782ee with identifier: KS56768
2025-12-05 17:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ba0ad4cb-6cc6-50a3-8092-6c86152782ee with identifier: KS56768 to the API
2025-12-05 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KS56768>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:34:14Z',
'fuel_type': 'diesel',
'id': 'ba0ad4cb-6cc6-50a3-8092-6c86152782ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS56768',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'BMW',
'model': '1er',
'odometer': 95838,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2018}
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS56768%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [auto1.fr] INFO: Saving data for KS56768: {'auction_closing_time': 1765038854.0, 'created_time': 1763053564.302989, 'last_price_update_time': 1764954338.576546}
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KS56768') HTTP/1.1" 204 0
2025-12-05 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7a7f8938f05b3e25100c9965c7204150.png> (referer: https://www.auto1.com/)
2025-12-05 17:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 with identifier: RH76441
2025-12-05 17:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 with scrape type 1
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg not downloaded yet
2025-12-05 17:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06b29ff2-4675-55d5-997d-d8ef2159d878 with identifier: ZA89800
2025-12-05 17:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06b29ff2-4675-55d5-997d-d8ef2159d878 with scrape type 2
2025-12-05 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06b29ff2-4675-55d5-997d-d8ef2159d878 with scrape type 2
2025-12-05 17:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 06b29ff2-4675-55d5-997d-d8ef2159d878, identifier: ZA89800
2025-12-05 17:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c44390>
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592e610>
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_69d6fc39903db66456a5daac630e1579.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5849d90>
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7da4cb79430c830eb8f679686121c0a0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7da4cb79430c830eb8f679686121c0a0.jpg saved to cache
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 06b29ff2-4675-55d5-997d-d8ef2159d878 with identifier: ZA89800
2025-12-05 17:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 06b29ff2-4675-55d5-997d-d8ef2159d878 with identifier: ZA89800
2025-12-05 17:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo innovation', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 70009, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/za89800', 'expiration_date': '2025-12-06t16:50:37z', 'origin_country_code': 'fr', 'trim': 'innovation', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 111, 'id': '06b29ff2-4675-55d5-997d-d8ef2159d878', 'current_year_diff': 8, 'age_in_months': 100, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 70009}
Failed validating None in schema:
False
On instance:
{'age_in_months': 100,
'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:50:37z',
'fuel_type': 'petrol',
'id': '06b29ff2-4675-55d5-997d-d8ef2159d878',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/za89800',
'listing': 'auction',
'location': 'fr, boé',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 70009,
'odometer_in_km': 70009,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo innovation',
'transmission': 'manual',
'trim': 'innovation',
'year': 2017}
2025-12-05 17:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 06b29ff2-4675-55d5-997d-d8ef2159d878 spider: auto1.fr
2025-12-05 17:05:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 06b29ff2-4675-55d5-997d-d8ef2159d878 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo innovation', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 70009, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/za89800', 'expiration_date': '2025-12-06t16:50:37z', 'origin_country_code': 'fr', 'trim': 'innovation', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 111, 'id': '06b29ff2-4675-55d5-997d-d8ef2159d878', 'current_year_diff': 8, 'age_in_months': 100, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 70009}
Failed validating None in schema:
False
On instance:
{'age_in_months': 100,
'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:50:37z',
'fuel_type': 'petrol',
'id': '06b29ff2-4675-55d5-997d-d8ef2159d878',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/za89800',
'listing': 'auction',
'location': 'fr, boé',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 70009,
'odometer_in_km': 70009,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo innovation',
'transmission': 'manual',
'trim': 'innovation',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:50:37Z',
'fuel_type': 'petrol',
'id': '06b29ff2-4675-55d5-997d-d8ef2159d878',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA89800',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 70009,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
'transmission': 'manual',
'trim': 'INNOVATION',
'year': 2017}
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA89800%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [auto1.fr] INFO: Saving data for ZA89800: {'auction_closing_time': 1765039837.0, 'created_time': 1764608762.847748, 'last_price_update_time': 1764954339.837035}
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZA89800') HTTP/1.1" 204 0
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg not downloaded yet
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_29cf494fe9db830603c94979a7a995f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg not downloaded yet
2025-12-05 17:05:39 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:05:39 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:05:39 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:05:39 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5874090>
2025-12-05 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_15.png HTTP/1.1" 201 0
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7a7f8938f05b3e25100c9965c7204150.png') HTTP/1.1" 204 0
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7a7f8938f05b3e25100c9965c7204150.png saved to cache
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_08b68ce63baf4049ccc46681543f9938.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_876534d7ab1bca804901640a1c01cff2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_6740f9b0c859815ce9326b34762f7136.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_88419ffb718b4e25a9813428f1a44ac0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_652c6f52f3c9725c5b324f72b244ff61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_a7e680fa8d6a640f610239eaee854e4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg not downloaded yet
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_e37a3190b663284a2c9d333794aebe6f.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png not downloaded yet
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF59773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY34409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f0b90>
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa6%252Ffca69a8061d2c48129f1eca29d5a491c%252Fpa%252FGJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg saved to cache
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff
2025-12-05 17:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff, skipping ID generation
2025-12-05 17:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff with scrape type 1
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff from tracking dictionaries
2025-12-05 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff sending to next pipeline
2025-12-05 17:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff, identifier: GJ30657
2025-12-05 17:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff with identifier: GJ30657
2025-12-05 17:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff with identifier: GJ30657
2025-12-05 17:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 57794, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30657', 'expiration_date': '2025-12-06t16:25:37z', 'origin_country_code': 'fr', 'trim': 'grand chic', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chambray-lès-tours', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 144, 'id': '66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2766885}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2721246}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2708484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62692}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60192}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2747214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2642315}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2727134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2779146}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2641170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2849623}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48884}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 110884}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png', 'Width': 800, 'Height': 450, 'Extension': 'png', 'FileSizeInBytes': 117591}], 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 57794}
Failed validating None in schema:
False
On instance:
{'age_in_months': 65,
'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 155,
'expiration_date': '2025-12-06t16:25:37z',
'fuel_type': 'petrol',
'id': '66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30657',
'listing': 'auction',
'location': 'fr, chambray-lès-tours',
'make': 'ds automobiles',
'make_model': 'ds automobiles ds3 crossback',
'model': 'ds3 crossback',
'odometer': 57794,
'odometer_in_km': 57794,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2766885,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2721246,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2747214,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2642315,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727134,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779146,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2641170,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849623,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 117591,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-17',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic',
'transmission': 'automatic',
'trim': 'grand chic',
'year': 2020}
2025-12-05 17:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff spider: auto1.fr
2025-12-05 17:05:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 57794, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30657', 'expiration_date': '2025-12-06t16:25:37z', 'origin_country_code': 'fr', 'trim': 'grand chic', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chambray-lès-tours', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 144, 'id': '66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2766885}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2721246}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2708484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62692}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60192}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2747214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2642315}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2727134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2779146}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2641170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2849623}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48884}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 110884}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png', 'Width': 800, 'Height': 450, 'Extension': 'png', 'FileSizeInBytes': 117591}], 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 57794}
Failed validating None in schema:
False
On instance:
{'age_in_months': 65,
'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 155,
'expiration_date': '2025-12-06t16:25:37z',
'fuel_type': 'petrol',
'id': '66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30657',
'listing': 'auction',
'location': 'fr, chambray-lès-tours',
'make': 'ds automobiles',
'make_model': 'ds automobiles ds3 crossback',
'model': 'ds3 crossback',
'odometer': 57794,
'odometer_in_km': 57794,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2766885,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2721246,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2747214,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2642315,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727134,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779146,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2641170,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849623,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 117591,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-17',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic',
'transmission': 'automatic',
'trim': 'grand chic',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 155,
'expiration_date': '2025-12-06T16:25:37Z',
'fuel_type': 'petrol',
'id': '66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ30657',
'listing': 'auction',
'location': 'FR, Chambray-Lès-Tours',
'make': 'DS Automobiles',
'model': 'DS3 Crossback',
'odometer': 57794,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2766885,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_a6568267ce8bd91bec6f69eff6b87613.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2721246,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_90969908842832f1c182f9321bbdfabf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708484,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_69d6fc39903db66456a5daac630e1579.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_8e06d4463f0b1a0abca826b92a06830f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4d72d4a2025568083cad55e0c1eada98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2747214,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4f00a6e4da27dc79cbfc680102be698b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2642315,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_63bd08753f6fb4bdcfc87c2433fb18d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727134,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_9db263a0fb208381de62f748934c19d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779146,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_639b5db7a017ec61a6a728d629c49e60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2641170,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_4355487a4e9dcf56bb8bf635441e9587.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_56eca106702111bb061891dc0ba8635f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849623,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_1c48b51060509b6cb36fdb90f8db5d42.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_74e1ae0e99a392c57022be4cf260b8af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_359207f7f94274464ed1ec0dd87a6361.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_d1f0f8bacf371532d9a25644b8aad0b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff/66f7307b-2a7b-5f8a-a0bd-efc6731cc6ff_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 117591,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a6/fca69a8061d2c48129f1eca29d5a491c/pa/GJ30657_b054f959ae506a7eaad3287bcd4e2b65.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Grand Chic',
'transmission': 'automatic',
'trim': 'Grand Chic',
'year': 2020}
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ30657%27 HTTP/1.1" 200 None
2025-12-05 17:05:41 [auto1.fr] INFO: Saving data for GJ30657: {'created_time': 1764954341.270674, 'last_price_update_time': 1764954341.270716, 'auction_closing_time': 1765038337.0}
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GJ30657') HTTP/1.1" 204 0
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png> (referer: https://www.auto1.com/)
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC77266> (referer: https://www.auto1.com/v1/car-details-view/WC77266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK94361> (referer: https://www.auto1.com/v1/car-details-view/LK94361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD63915> (referer: https://www.auto1.com/v1/car-details-view/VD63915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e80590>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg saved to cache
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF88675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT12965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4a290>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_a7e680fa8d6a640f610239eaee854e4c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg saved to cache
2025-12-05 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:05:41 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dc7b90>
2025-12-05 17:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_15.png HTTP/1.1" 201 0
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_e37a3190b663284a2c9d333794aebe6f.png') HTTP/1.1" 204 0
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png saved to cache
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d8f1de8-8704-549b-adcb-083c0013192b with identifier: WC77266
2025-12-05 17:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d8f1de8-8704-549b-adcb-083c0013192b with scrape type 2
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d8f1de8-8704-549b-adcb-083c0013192b with scrape type 2
2025-12-05 17:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d8f1de8-8704-549b-adcb-083c0013192b, identifier: WC77266
2025-12-05 17:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ac2116-124a-5f1a-8953-f128b45decbc with identifier: LK94361
2025-12-05 17:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ac2116-124a-5f1a-8953-f128b45decbc with scrape type 2
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ac2116-124a-5f1a-8953-f128b45decbc with scrape type 2
2025-12-05 17:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 97ac2116-124a-5f1a-8953-f128b45decbc, identifier: LK94361
2025-12-05 17:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a26e3ea-c662-516f-ae6e-e099b52781e7 with identifier: VD63915
2025-12-05 17:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a26e3ea-c662-516f-ae6e-e099b52781e7 with scrape type 1
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_c66c23375cafa370b54755013f8f9628.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_c66c23375cafa370b54755013f8f9628.jpg not downloaded yet
2025-12-05 17:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d8f1de8-8704-549b-adcb-083c0013192b with identifier: WC77266
2025-12-05 17:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d8f1de8-8704-549b-adcb-083c0013192b with identifier: WC77266
2025-12-05 17:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d8f1de8-8704-549b-adcb-083c0013192b with identifier: WC77266 to the API
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC77266>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 165,
'expiration_date': '2025-12-06T16:43:27Z',
'fuel_type': 'petrol',
'id': '6d8f1de8-8704-549b-adcb-083c0013192b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC77266',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Peugeot',
'model': '3008',
'odometer': 55406,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC77266%27 HTTP/1.1" 200 None
2025-12-05 17:05:42 [auto1.fr] INFO: Saving data for WC77266: {'auction_closing_time': 1765039407.0, 'created_time': 1762275962.0605, 'last_price_update_time': 1764954342.882617}
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WC77266') HTTP/1.1" 204 0
2025-12-05 17:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 97ac2116-124a-5f1a-8953-f128b45decbc with identifier: LK94361
2025-12-05 17:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 97ac2116-124a-5f1a-8953-f128b45decbc with identifier: LK94361
2025-12-05 17:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 97ac2116-124a-5f1a-8953-f128b45decbc with identifier: LK94361 to the API
2025-12-05 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LK94361>
{'auction_title': '',
'c_o_2_emission_value': 49,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 261,
'expiration_date': '2025-12-06T16:22:58Z',
'fuel_type': 'hybrid',
'id': '97ac2116-124a-5f1a-8953-f128b45decbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK94361',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volvo',
'model': 'XC40',
'odometer': 74621,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2020}
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK94361%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [auto1.fr] INFO: Saving data for LK94361: {'auction_closing_time': 1765038178.0, 'created_time': 1762277721.346324, 'last_price_update_time': 1764954343.265205}
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LK94361') HTTP/1.1" 204 0
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_9433db05a1ee1a87fad5051b61dc581c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_9433db05a1ee1a87fad5051b61dc581c.jpg not downloaded yet
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP30057> (referer: https://www.auto1.com/v1/car-details-view/AP30057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT88600> (referer: https://www.auto1.com/v1/car-details-view/FT88600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF17814> (referer: https://www.auto1.com/v1/car-details-view/RF17814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg not downloaded yet
2025-12-05 17:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_2ce088e67c1efbf41ed77a5cf46a737a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ce088e67c1efbf41ed77a5cf46a737a.jpg not downloaded yet
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_527b77a3e7cd846b6ed608bde188c448.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_527b77a3e7cd846b6ed608bde188c448.jpg not downloaded yet
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_e33767374fd5b9ecbd7ea3ab70c8afa7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_e33767374fd5b9ecbd7ea3ab70c8afa7.jpg not downloaded yet
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_4eb11294996646e3d2f369939f676199.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_4eb11294996646e3d2f369939f676199.jpg not downloaded yet
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dab410>
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_652c6f52f3c9725c5b324f72b244ff61.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg saved to cache
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_9433db05a1ee1a87fad5051b61dc581c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_b8ffbfe51f43add83a1a1692b259b9b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_b8ffbfe51f43add83a1a1692b259b9b3.jpg not downloaded yet
2025-12-05 17:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1601374e-01c4-5990-ba2c-11ee56987963 with identifier: AP30057
2025-12-05 17:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1601374e-01c4-5990-ba2c-11ee56987963 with scrape type 1
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1601374e-01c4-5990-ba2c-11ee56987963
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_5bf6dec1fc9df9d1301e7627c01ec401.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_5bf6dec1fc9df9d1301e7627c01ec401.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_d42b5cee5a9d6c001ff924191ffa899d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_d42b5cee5a9d6c001ff924191ffa899d.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_fb494c174aca80b4514e3a13d7daf649.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fb494c174aca80b4514e3a13d7daf649.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_47bd509a620fb3c2f0d0d0f2bef91f8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_47bd509a620fb3c2f0d0d0f2bef91f8d.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_fd5c69c8f368f48c6431b6290a36e904.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fd5c69c8f368f48c6431b6290a36e904.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_40b9089d40b84b94d18c31fb194ef881.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_40b9089d40b84b94d18c31fb194ef881.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_f948dc0ba8810f15d099c0fdf7bb5276.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_f948dc0ba8810f15d099c0fdf7bb5276.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_0f166596f2318712dcfabcf6274f1764.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_0f166596f2318712dcfabcf6274f1764.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_fdf9ef5079ad1aef146d261989ac95d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fdf9ef5079ad1aef146d261989ac95d9.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_edd765598d60faa4209d114da9440516.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_edd765598d60faa4209d114da9440516.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_909b8a863d23cb0264a779b75a086124.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_909b8a863d23cb0264a779b75a086124.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_295766f6b503611c8dc4a553ba2df6ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_295766f6b503611c8dc4a553ba2df6ec.jpg already downloaded
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_56aa4a91068735dfb7d6a69ca6f8ed18.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_56aa4a91068735dfb7d6a69ca6f8ed18.jpg already downloaded
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_5a1b173fc5e704ba8e490acc6641fb9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_5a1b173fc5e704ba8e490acc6641fb9f.jpg already downloaded
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_fafd83dc0416c56b161e9d6d71e40fb4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fafd83dc0416c56b161e9d6d71e40fb4.jpg already downloaded
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F18%252F2518fef7470d7e7f75f0cd8803d6f212%252Fpa%252FAP30057_08e4cf4ae4c5b9ea831c8a9030674eb1.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_08e4cf4ae4c5b9ea831c8a9030674eb1.png already downloaded
2025-12-05 17:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1601374e-01c4-5990-ba2c-11ee56987963, identifier: AP30057
2025-12-05 17:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1c76d1-742e-5b95-955b-5499512798b2 with identifier: FT88600
2025-12-05 17:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1c76d1-742e-5b95-955b-5499512798b2 with scrape type 2
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1c76d1-742e-5b95-955b-5499512798b2 with scrape type 2
2025-12-05 17:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf1c76d1-742e-5b95-955b-5499512798b2, identifier: FT88600
2025-12-05 17:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08535020-0c03-53ab-8c63-d27554355edf with identifier: RF17814
2025-12-05 17:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08535020-0c03-53ab-8c63-d27554355edf with scrape type 1
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_9568978e8ed012005d0feabc0b186e18.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_9568978e8ed012005d0feabc0b186e18.jpg not downloaded yet
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_cb9515800a10f7d200e72180b03254af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_cb9515800a10f7d200e72180b03254af.jpg not downloaded yet
2025-12-05 17:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1601374e-01c4-5990-ba2c-11ee56987963 with identifier: AP30057
2025-12-05 17:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1601374e-01c4-5990-ba2c-11ee56987963 with identifier: AP30057
2025-12-05 17:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1601374e-01c4-5990-ba2c-11ee56987963 with identifier: AP30057 to the API
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AP30057>
{'auction_title': '',
'c_o_2_emission_value': 36,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 252,
'expiration_date': '2025-12-06T16:21:56Z',
'fuel_type': 'hybrid',
'id': '1601374e-01c4-5990-ba2c-11ee56987963',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP30057',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'BMW',
'model': '3er',
'odometer': 110106,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_5bf6dec1fc9df9d1301e7627c01ec401.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_d42b5cee5a9d6c001ff924191ffa899d.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fb494c174aca80b4514e3a13d7daf649.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_47bd509a620fb3c2f0d0d0f2bef91f8d.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fd5c69c8f368f48c6431b6290a36e904.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_40b9089d40b84b94d18c31fb194ef881.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_f948dc0ba8810f15d099c0fdf7bb5276.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_0f166596f2318712dcfabcf6274f1764.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fdf9ef5079ad1aef146d261989ac95d9.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_edd765598d60faa4209d114da9440516.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_909b8a863d23cb0264a779b75a086124.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_295766f6b503611c8dc4a553ba2df6ec.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_56aa4a91068735dfb7d6a69ca6f8ed18.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_5a1b173fc5e704ba8e490acc6641fb9f.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fafd83dc0416c56b161e9d6d71e40fb4.jpg',
'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_08e4cf4ae4c5b9ea831c8a9030674eb1.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_5bf6dec1fc9df9d1301e7627c01ec401.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_d42b5cee5a9d6c001ff924191ffa899d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fb494c174aca80b4514e3a13d7daf649.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_47bd509a620fb3c2f0d0d0f2bef91f8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fd5c69c8f368f48c6431b6290a36e904.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_40b9089d40b84b94d18c31fb194ef881.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_f948dc0ba8810f15d099c0fdf7bb5276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_0f166596f2318712dcfabcf6274f1764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fdf9ef5079ad1aef146d261989ac95d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_edd765598d60faa4209d114da9440516.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_909b8a863d23cb0264a779b75a086124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_295766f6b503611c8dc4a553ba2df6ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_56aa4a91068735dfb7d6a69ca6f8ed18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_5a1b173fc5e704ba8e490acc6641fb9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_fafd83dc0416c56b161e9d6d71e40fb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1601374e-01c4-5990-ba2c-11ee56987963/1601374e-01c4-5990-ba2c-11ee56987963_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 118871,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img25/18/2518fef7470d7e7f75f0cd8803d6f212/pa/AP30057_08e4cf4ae4c5b9ea831c8a9030674eb1.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 330e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP30057%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [auto1.fr] INFO: Saving data for AP30057: {'created_time': 1764954344.562763, 'last_price_update_time': 1764954344.562774, 'auction_closing_time': 1765038116.0}
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AP30057') HTTP/1.1" 204 0
2025-12-05 17:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf1c76d1-742e-5b95-955b-5499512798b2 with identifier: FT88600
2025-12-05 17:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf1c76d1-742e-5b95-955b-5499512798b2 with identifier: FT88600
2025-12-05 17:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171702 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171702
2025-12-05 17:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bf1c76d1-742e-5b95-955b-5499512798b2 spider: auto1.fr
2025-12-05 17:05:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bf1c76d1-742e-5b95-955b-5499512798b2 due to rule: high_mileage_for_country.json, error: 171702 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171702
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:16:29Z',
'fuel_type': 'diesel',
'id': 'bf1c76d1-742e-5b95-955b-5499512798b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT88600',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 171702,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Carat 4Motion BlueMotion',
'year': 2017}
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT88600%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [auto1.fr] INFO: Saving data for FT88600: {'auction_closing_time': 1765037789.0, 'created_time': 1764151465.376148, 'last_price_update_time': 1764954344.794992}
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FT88600') HTTP/1.1" 204 0
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_3b92a93921a65c51876354828d1862ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_3b92a93921a65c51876354828d1862ed.jpg not downloaded yet
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_aa3e494baacee9a3df5c5e8d1e534717.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_aa3e494baacee9a3df5c5e8d1e534717.jpg not downloaded yet
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX05561> (referer: https://www.auto1.com/v1/car-details-view/LX05561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU05475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM00106> (referer: https://www.auto1.com/v1/car-details-view/VM00106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594c690>
2025-12-05 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_9433db05a1ee1a87fad5051b61dc581c.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_9433db05a1ee1a87fad5051b61dc581c.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_98c1cc30203f7d91479af1836b783bb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_98c1cc30203f7d91479af1836b783bb1.jpg not downloaded yet
2025-12-05 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_4eb11294996646e3d2f369939f676199.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_859100c4caca3ed3aa669880875ce69d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_859100c4caca3ed3aa669880875ce69d.jpg not downloaded yet
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f5b50>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_6740f9b0c859815ce9326b34762f7136.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d5eb90>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_876534d7ab1bca804901640a1c01cff2.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg saved to cache
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_099efa849e4655992e4b5dce25211aca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_099efa849e4655992e4b5dce25211aca.jpg not downloaded yet
2025-12-05 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY34409> (referer: https://www.auto1.com/v1/car-details-view/BY34409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_ec80c46bbcb4750462eb093baa926c06.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ec80c46bbcb4750462eb093baa926c06.jpg not downloaded yet
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_7f57bfe62c422548448bdbf27217d024.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7f57bfe62c422548448bdbf27217d024.jpg not downloaded yet
2025-12-05 17:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952cb941-3315-5083-8e72-92595a0b96fa with identifier: LX05561
2025-12-05 17:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952cb941-3315-5083-8e72-92595a0b96fa with scrape type 2
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 952cb941-3315-5083-8e72-92595a0b96fa with scrape type 2
2025-12-05 17:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 952cb941-3315-5083-8e72-92595a0b96fa, identifier: LX05561
2025-12-05 17:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ad9fb1-0559-5d30-be9c-a690f2222626 with identifier: VM00106
2025-12-05 17:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ad9fb1-0559-5d30-be9c-a690f2222626 with scrape type 1
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg not downloaded yet
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ac8190>
2025-12-05 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_4eb11294996646e3d2f369939f676199.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_4eb11294996646e3d2f369939f676199.jpg saved to cache
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_84261b3bcbc934d367f992f7078f140d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_84261b3bcbc934d367f992f7078f140d.jpg not downloaded yet
2025-12-05 17:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 952cb941-3315-5083-8e72-92595a0b96fa with identifier: LX05561
2025-12-05 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 952cb941-3315-5083-8e72-92595a0b96fa with identifier: LX05561
2025-12-05 17:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 952cb941-3315-5083-8e72-92595a0b96fa with identifier: LX05561 to the API
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX05561>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2025-12-06T16:47:05Z',
'fuel_type': 'diesel',
'id': '952cb941-3315-5083-8e72-92595a0b96fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX05561',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 118779,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 d Starlight Edition',
'transmission': 'automatic',
'trim': 'Starlight Edition',
'year': 2018}
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX05561%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [auto1.fr] INFO: Saving data for LX05561: {'auction_closing_time': 1765039625.0, 'created_time': 1763546607.448196, 'last_price_update_time': 1764954346.597667}
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LX05561') HTTP/1.1" 204 0
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_b8ffbfe51f43add83a1a1692b259b9b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_e33767374fd5b9ecbd7ea3ab70c8afa7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_200246f9f5db505cfb61f5775b27527f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_200246f9f5db505cfb61f5775b27527f.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_76434a2a9fd869890c1fffe922172395.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_76434a2a9fd869890c1fffe922172395.jpg not downloaded yet
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF59773> (referer: https://www.auto1.com/v1/car-details-view/WF59773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM61859> (referer: https://www.auto1.com/v1/car-details-view/HM61859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575d7d0>
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg saved to cache
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409
2025-12-05 17:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6718eaa-9efe-519e-9722-92529cfc3c2f with scrape type 1
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_38dacb7e9e39f3cff7591e3416783b00.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_38dacb7e9e39f3cff7591e3416783b00.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_35bba16b9d8faeb0451c17a37355cea7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_35bba16b9d8faeb0451c17a37355cea7.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg not downloaded yet
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_972b9f2029f4f0f53427e23da2aed906.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_972b9f2029f4f0f53427e23da2aed906.jpg not downloaded yet
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_795ea40a78caa7c2023c0007ad2c638f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_795ea40a78caa7c2023c0007ad2c638f.jpg not downloaded yet
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_4203ce38ef81499cc58b41270512e14f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_4203ce38ef81499cc58b41270512e14f.jpg not downloaded yet
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_973defc2b9b96b25310373de8e393e0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg not downloaded yet
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ee4d0>
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_b8ffbfe51f43add83a1a1692b259b9b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_b8ffbfe51f43add83a1a1692b259b9b3.jpg saved to cache
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfcb10>
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_e33767374fd5b9ecbd7ea3ab70c8afa7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_e33767374fd5b9ecbd7ea3ab70c8afa7.jpg saved to cache
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e230ddd-5df2-5923-8b92-80d7878d996f with identifier: WF59773
2025-12-05 17:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e230ddd-5df2-5923-8b92-80d7878d996f with scrape type 1
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_13482f861b4ea13d89853d47098415c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_13482f861b4ea13d89853d47098415c5.jpg not downloaded yet
2025-12-05 17:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63365f55-faa3-5820-90de-f9688f05689b with identifier: HM61859
2025-12-05 17:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63365f55-faa3-5820-90de-f9688f05689b with scrape type 1
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 63365f55-faa3-5820-90de-f9688f05689b
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_9bcda96d4a0ec67a893c89f82d2aa207.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9bcda96d4a0ec67a893c89f82d2aa207.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_7aa89c5441c2a816f9f7b14401748a67.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_7aa89c5441c2a816f9f7b14401748a67.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_248180ce98d1428008bb908892581c90.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_248180ce98d1428008bb908892581c90.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_d87231aea0005197d676a3d00575489d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_d87231aea0005197d676a3d00575489d.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_005dd67f1ea58949024578675b307af5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_005dd67f1ea58949024578675b307af5.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_1f47d30f25f7f46d6d30169f07c8a1bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_1f47d30f25f7f46d6d30169f07c8a1bc.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_3b24437b391f57fd79cd46ca319098db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_3b24437b391f57fd79cd46ca319098db.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_d3afd8d1faa7566edae6b21976c9c437.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_d3afd8d1faa7566edae6b21976c9c437.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_92ded1a0b88f48a4782804f849836562.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_92ded1a0b88f48a4782804f849836562.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_9aeafb1ddf78e9b45277303063f172f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9aeafb1ddf78e9b45277303063f172f8.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_325a10f5ac90c8731cbb75ba41267804.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_325a10f5ac90c8731cbb75ba41267804.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_66015cdea6e2490f68efd75ce573fabc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_66015cdea6e2490f68efd75ce573fabc.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_b280552eeaaeb15db3c125bf3b04c1f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_b280552eeaaeb15db3c125bf3b04c1f8.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_9f1abfe7d119772efc56690386984275.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9f1abfe7d119772efc56690386984275.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_375f2fdc80580a3eabae8252d56ee0f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_375f2fdc80580a3eabae8252d56ee0f4.jpg already downloaded
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff7%252F7df7ee2ee5285538913bd8139304b22d%252Fpa%252FHM61859_ad0dd240bc7f425975275176a9640f39.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_ad0dd240bc7f425975275176a9640f39.png already downloaded
2025-12-05 17:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 63365f55-faa3-5820-90de-f9688f05689b, identifier: HM61859
2025-12-05 17:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_aa3e494baacee9a3df5c5e8d1e534717.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_ba265ca6556d6b5ab04f754acf82393d.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ba265ca6556d6b5ab04f754acf82393d.png not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_519878a6d1aae79de23305237630bca3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_519878a6d1aae79de23305237630bca3.jpg not downloaded yet
2025-12-05 17:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 63365f55-faa3-5820-90de-f9688f05689b with identifier: HM61859
2025-12-05 17:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 63365f55-faa3-5820-90de-f9688f05689b with identifier: HM61859
2025-12-05 17:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 63365f55-faa3-5820-90de-f9688f05689b with identifier: HM61859 to the API
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM61859>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:38:01Z',
'fuel_type': 'gas',
'id': '63365f55-faa3-5820-90de-f9688f05689b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM61859',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Renault',
'model': 'Clio',
'odometer': 54808,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9bcda96d4a0ec67a893c89f82d2aa207.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_7aa89c5441c2a816f9f7b14401748a67.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_248180ce98d1428008bb908892581c90.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_d87231aea0005197d676a3d00575489d.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_005dd67f1ea58949024578675b307af5.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_1f47d30f25f7f46d6d30169f07c8a1bc.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_3b24437b391f57fd79cd46ca319098db.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_d3afd8d1faa7566edae6b21976c9c437.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_92ded1a0b88f48a4782804f849836562.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9aeafb1ddf78e9b45277303063f172f8.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_325a10f5ac90c8731cbb75ba41267804.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_66015cdea6e2490f68efd75ce573fabc.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_b280552eeaaeb15db3c125bf3b04c1f8.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9f1abfe7d119772efc56690386984275.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_375f2fdc80580a3eabae8252d56ee0f4.jpg',
'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_ad0dd240bc7f425975275176a9640f39.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9bcda96d4a0ec67a893c89f82d2aa207.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_7aa89c5441c2a816f9f7b14401748a67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_248180ce98d1428008bb908892581c90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_d87231aea0005197d676a3d00575489d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_005dd67f1ea58949024578675b307af5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_1f47d30f25f7f46d6d30169f07c8a1bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_3b24437b391f57fd79cd46ca319098db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_d3afd8d1faa7566edae6b21976c9c437.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457548,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_92ded1a0b88f48a4782804f849836562.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9aeafb1ddf78e9b45277303063f172f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_325a10f5ac90c8731cbb75ba41267804.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_66015cdea6e2490f68efd75ce573fabc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_b280552eeaaeb15db3c125bf3b04c1f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_9f1abfe7d119772efc56690386984275.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1012645,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_375f2fdc80580a3eabae8252d56ee0f4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63365f55-faa3-5820-90de-f9688f05689b/63365f55-faa3-5820-90de-f9688f05689b_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 76093,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f7/7df7ee2ee5285538913bd8139304b22d/pa/HM61859_ad0dd240bc7f425975275176a9640f39.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe LPG Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2021}
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM61859%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [auto1.fr] INFO: Saving data for HM61859: {'created_time': 1764954348.408623, 'last_price_update_time': 1764954348.408632, 'auction_closing_time': 1765039081.0}
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM61859') HTTP/1.1" 204 0
2025-12-05 17:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_3b92a93921a65c51876354828d1862ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_7c6da4ddb3997e53695637f23bc19fb9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7c6da4ddb3997e53695637f23bc19fb9.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_8861945bc604be0973c76fa9774365a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_39b070c9014d06e35a2a844cfc80a193.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_39b070c9014d06e35a2a844cfc80a193.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_a86399e104c5e470126796a2946b1b6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a86399e104c5e470126796a2946b1b6b.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_5711fefcf5ef7c1891ef54a74db5d0c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5711fefcf5ef7c1891ef54a74db5d0c5.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_8f76ba36a799e7b83089843c3187ac77.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_af47c24facfbe4273eee9bb11d9a39b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_af47c24facfbe4273eee9bb11d9a39b3.jpg not downloaded yet
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_f1eec5fe2a52090a3d320201f850db7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_f1eec5fe2a52090a3d320201f850db7f.jpg not downloaded yet
2025-12-05 17:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59704d0>
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg saved to cache
2025-12-05 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5927610>
2025-12-05 17:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_aa3e494baacee9a3df5c5e8d1e534717.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_aa3e494baacee9a3df5c5e8d1e534717.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_9568978e8ed012005d0feabc0b186e18.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_5d00895e56a8a1102e9054b313e29de8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5d00895e56a8a1102e9054b313e29de8.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_a5d8f16c51969c809b917f3687d58213.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_a5d8f16c51969c809b917f3687d58213.jpg not downloaded yet
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_98c1cc30203f7d91479af1836b783bb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_10c8f553f92a926aa5913c41ee754269.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_10c8f553f92a926aa5913c41ee754269.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_5cefc377f4eba84139d276219b8d49c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5cefc377f4eba84139d276219b8d49c6.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_06e807fa2f0b8ab1bbbbfe0b9d1a2727.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_06e807fa2f0b8ab1bbbbfe0b9d1a2727.jpg not downloaded yet
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c8850>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_3b92a93921a65c51876354828d1862ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_3b92a93921a65c51876354828d1862ed.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_c088e526d2f003a8c2e95de3cba235a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_c088e526d2f003a8c2e95de3cba235a2.jpg not downloaded yet
2025-12-05 17:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_099efa849e4655992e4b5dce25211aca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_53ba01428ba80d0289f87266eecac9cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_53ba01428ba80d0289f87266eecac9cf.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_da0413f1eb51494b15160950f7da7f6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_3f2d03544e0f7d851a9de0db3d635ee4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3f2d03544e0f7d851a9de0db3d635ee4.jpg not downloaded yet
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_4c8d9d73bdc0c406e0dc9804b77e736c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_4c8d9d73bdc0c406e0dc9804b77e736c.jpg not downloaded yet
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdfc90>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_9568978e8ed012005d0feabc0b186e18.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_9568978e8ed012005d0feabc0b186e18.jpg saved to cache
2025-12-05 17:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5973210>
2025-12-05 17:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_98c1cc30203f7d91479af1836b783bb1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_98c1cc30203f7d91479af1836b783bb1.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_84261b3bcbc934d367f992f7078f140d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_672465594ce096e6fed2c4a022eff069.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_672465594ce096e6fed2c4a022eff069.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_b6e32b83c13f77866c2d960955946c42.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_7d941cf0698dad3c7943ae2f9855a472.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_7d941cf0698dad3c7943ae2f9855a472.jpg not downloaded yet
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_a018ef852d8ea828522524c550fb3579.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a018ef852d8ea828522524c550fb3579.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_ff6349c4fe1effa62a5ac28602551ef8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_ff6349c4fe1effa62a5ac28602551ef8.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_da7fd9d9a18c7353a83f81914f17150c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_9bcf226d01ed1625ea4db9f272c845e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_9bcf226d01ed1625ea4db9f272c845e9.jpg not downloaded yet
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ee2d0>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_099efa849e4655992e4b5dce25211aca.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_099efa849e4655992e4b5dce25211aca.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_46e144d6b791be27e9a075baeabc50ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_46e144d6b791be27e9a075baeabc50ba.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_f4f0c98f192da47eeac45dfd9814e808.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_f4f0c98f192da47eeac45dfd9814e808.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg not downloaded yet
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_e3290ece47059b7e62076a01f60b22b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e3290ece47059b7e62076a01f60b22b6.jpg not downloaded yet
2025-12-05 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_71c70493f1615417e79b12d72697204b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_71c70493f1615417e79b12d72697204b.jpg not downloaded yet
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb3f50>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_84261b3bcbc934d367f992f7078f140d.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_84261b3bcbc934d367f992f7078f140d.jpg saved to cache
2025-12-05 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cde990>
2025-12-05 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_88419ffb718b4e25a9813428f1a44ac0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg saved to cache
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg not downloaded yet
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_e7748830fc0e96f64547d16d4c3c73a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e7748830fc0e96f64547d16d4c3c73a5.jpg not downloaded yet
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_13482f861b4ea13d89853d47098415c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_1b2dd7e957186cb94b05823dedce18bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_1b2dd7e957186cb94b05823dedce18bb.jpg not downloaded yet
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_aa71950427a498cebb33951985982e2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg not downloaded yet
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_b757a8ab022e06a7890b2dceb4be1033.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_b757a8ab022e06a7890b2dceb4be1033.jpg not downloaded yet
2025-12-05 17:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5781290>
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg saved to cache
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ded850>
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg saved to cache
2025-12-05 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57c0dd0>
2025-12-05 17:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_3920a58b566715a81d1a310735ff5a62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_3920a58b566715a81d1a310735ff5a62.jpg not downloaded yet
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_4203ce38ef81499cc58b41270512e14f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg not downloaded yet
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_60b3f0651072825d8b9ba0e01c1fecfc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_60b3f0651072825d8b9ba0e01c1fecfc.jpg not downloaded yet
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_14595f7d6cf7e776d068dbc338a0e6ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_14595f7d6cf7e776d068dbc338a0e6ce.jpg not downloaded yet
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d11f90>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_13482f861b4ea13d89853d47098415c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_13482f861b4ea13d89853d47098415c5.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f2d50>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_973defc2b9b96b25310373de8e393e0f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg saved to cache
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg not downloaded yet
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_5678ee59c24b38b8badf8e8c8f1a1e43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5678ee59c24b38b8badf8e8c8f1a1e43.jpg not downloaded yet
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_a5d8f16c51969c809b917f3687d58213.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_6729e74f314980e787365b411c05307e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_6729e74f314980e787365b411c05307e.jpg not downloaded yet
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_af47c24facfbe4273eee9bb11d9a39b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg not downloaded yet
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_3c41cd28045a355d9b8537f1b361d23b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3c41cd28045a355d9b8537f1b361d23b.jpg not downloaded yet
2025-12-05 17:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5abac10>
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg saved to cache
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a21f50>
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_4203ce38ef81499cc58b41270512e14f.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_4203ce38ef81499cc58b41270512e14f.jpg saved to cache
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3f2d03544e0f7d851a9de0db3d635ee4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_50c5fa82c76b1dd586567226d16b4129.png%27 HTTP/1.1" 200 None
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_50c5fa82c76b1dd586567226d16b4129.png not downloaded yet
2025-12-05 17:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_c66c23375cafa370b54755013f8f9628.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg not downloaded yet
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_e1d3278799da315d98b00522aec6ddf8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e1d3278799da315d98b00522aec6ddf8.jpg not downloaded yet
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f2790>
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_a5d8f16c51969c809b917f3687d58213.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_a5d8f16c51969c809b917f3687d58213.jpg saved to cache
2025-12-05 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d60690>
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_08b68ce63baf4049ccc46681543f9938.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575cb90>
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_af47c24facfbe4273eee9bb11d9a39b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_af47c24facfbe4273eee9bb11d9a39b3.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e7748830fc0e96f64547d16d4c3c73a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_932e8f6a261868504787f276c1243fa4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg not downloaded yet
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_5177a269365e42329f8af975cd077a49.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5177a269365e42329f8af975cd077a49.jpg not downloaded yet
2025-12-05 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_7d941cf0698dad3c7943ae2f9855a472.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_2f3e38c6103a048a0e988b3ff2251983.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg not downloaded yet
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_4baea8130a535d3921485457fd40a190.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_4baea8130a535d3921485457fd40a190.jpg not downloaded yet
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_d33e0588106aa0a2c2bc27b22ead35d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_d33e0588106aa0a2c2bc27b22ead35d0.jpg not downloaded yet
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57dcb50>
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_3f2d03544e0f7d851a9de0db3d635ee4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3f2d03544e0f7d851a9de0db3d635ee4.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5abb6d0>
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_c66c23375cafa370b54755013f8f9628.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_c66c23375cafa370b54755013f8f9628.jpg saved to cache
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_60b3f0651072825d8b9ba0e01c1fecfc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e3290ece47059b7e62076a01f60b22b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_302d3e7020cc46ecae35c24dad4cc822.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_302d3e7020cc46ecae35c24dad4cc822.jpg not downloaded yet
2025-12-05 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_1759046fc624d0485fdcb86a8d488c31.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_1759046fc624d0485fdcb86a8d488c31.jpg not downloaded yet
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd3010>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_e7748830fc0e96f64547d16d4c3c73a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e7748830fc0e96f64547d16d4c3c73a5.jpg saved to cache
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd2d90>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg saved to cache
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf2210>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_7d941cf0698dad3c7943ae2f9855a472.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_7d941cf0698dad3c7943ae2f9855a472.jpg saved to cache
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5177a269365e42329f8af975cd077a49.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e1d3278799da315d98b00522aec6ddf8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a82050>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_60b3f0651072825d8b9ba0e01c1fecfc.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_60b3f0651072825d8b9ba0e01c1fecfc.jpg saved to cache
2025-12-05 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a204d0>
2025-12-05 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_e3290ece47059b7e62076a01f60b22b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e3290ece47059b7e62076a01f60b22b6.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a204d0>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3c41cd28045a355d9b8537f1b361d23b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_50c5fa82c76b1dd586567226d16b4129.png> (referer: https://www.auto1.com/)
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a9ca50>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_932e8f6a261868504787f276c1243fa4.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a27c50>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_5177a269365e42329f8af975cd077a49.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5177a269365e42329f8af975cd077a49.jpg saved to cache
2025-12-05 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c84d0>
2025-12-05 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_e1d3278799da315d98b00522aec6ddf8.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e1d3278799da315d98b00522aec6ddf8.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_6729e74f314980e787365b411c05307e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_cb9515800a10f7d200e72180b03254af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cc0910>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a9f4d0>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_3c41cd28045a355d9b8537f1b361d23b.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3c41cd28045a355d9b8537f1b361d23b.jpg saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:57 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:05:57 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:05:57 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:05:57 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592c290>
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_15.png HTTP/1.1" 201 0
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_50c5fa82c76b1dd586567226d16b4129.png') HTTP/1.1" 204 0
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_50c5fa82c76b1dd586567226d16b4129.png saved to cache
2025-12-05 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_d33e0588106aa0a2c2bc27b22ead35d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_4baea8130a535d3921485457fd40a190.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5f050>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg saved to cache
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c588d510>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_6729e74f314980e787365b411c05307e.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_6729e74f314980e787365b411c05307e.jpg saved to cache
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:05:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592d9d0>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_cb9515800a10f7d200e72180b03254af.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_cb9515800a10f7d200e72180b03254af.jpg saved to cache
2025-12-05 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_1759046fc624d0485fdcb86a8d488c31.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_302d3e7020cc46ecae35c24dad4cc822.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5678ee59c24b38b8badf8e8c8f1a1e43.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_c088e526d2f003a8c2e95de3cba235a2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cfa350>
2025-12-05 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_d33e0588106aa0a2c2bc27b22ead35d0.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_d33e0588106aa0a2c2bc27b22ead35d0.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf07d0>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_4baea8130a535d3921485457fd40a190.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_4baea8130a535d3921485457fd40a190.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e503d0>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_2f3e38c6103a048a0e988b3ff2251983.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_3920a58b566715a81d1a310735ff5a62.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_b757a8ab022e06a7890b2dceb4be1033.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0a490>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_1759046fc624d0485fdcb86a8d488c31.jpg') HTTP/1.1" 204 0
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_1759046fc624d0485fdcb86a8d488c31.jpg saved to cache
2025-12-05 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cdddd0>
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_302d3e7020cc46ecae35c24dad4cc822.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_302d3e7020cc46ecae35c24dad4cc822.jpg saved to cache
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfc050>
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_5678ee59c24b38b8badf8e8c8f1a1e43.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5678ee59c24b38b8badf8e8c8f1a1e43.jpg saved to cache
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5780650>
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg saved to cache
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a4e610>
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_c088e526d2f003a8c2e95de3cba235a2.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_c088e526d2f003a8c2e95de3cba235a2.jpg saved to cache
2025-12-05 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_200246f9f5db505cfb61f5775b27527f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_1b2dd7e957186cb94b05823dedce18bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_f4f0c98f192da47eeac45dfd9814e808.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_71c70493f1615417e79b12d72697204b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c9c90>
2025-12-05 17:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_aa71950427a498cebb33951985982e2e.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ef250>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_3920a58b566715a81d1a310735ff5a62.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_3920a58b566715a81d1a310735ff5a62.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b7010>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_b757a8ab022e06a7890b2dceb4be1033.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_b757a8ab022e06a7890b2dceb4be1033.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_46e144d6b791be27e9a075baeabc50ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_9bcf226d01ed1625ea4db9f272c845e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_ff6349c4fe1effa62a5ac28602551ef8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5775350>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg saved to cache
2025-12-05 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cddad0>
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_200246f9f5db505cfb61f5775b27527f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_200246f9f5db505cfb61f5775b27527f.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a4dd0>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_1b2dd7e957186cb94b05823dedce18bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_1b2dd7e957186cb94b05823dedce18bb.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c911d0>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_f4f0c98f192da47eeac45dfd9814e808.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_f4f0c98f192da47eeac45dfd9814e808.jpg saved to cache
2025-12-05 17:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb50d0>
2025-12-05 17:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_71c70493f1615417e79b12d72697204b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_71c70493f1615417e79b12d72697204b.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_4c8d9d73bdc0c406e0dc9804b77e736c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c91a50>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_46e144d6b791be27e9a075baeabc50ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_46e144d6b791be27e9a075baeabc50ba.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cdc090>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_b6e32b83c13f77866c2d960955946c42.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c920d0>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_9bcf226d01ed1625ea4db9f272c845e9.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_9bcf226d01ed1625ea4db9f272c845e9.jpg saved to cache
2025-12-05 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e20e10>
2025-12-05 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_ff6349c4fe1effa62a5ac28602551ef8.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_ff6349c4fe1effa62a5ac28602551ef8.jpg saved to cache
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb5690>
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_da7fd9d9a18c7353a83f81914f17150c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg saved to cache
2025-12-05 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_53ba01428ba80d0289f87266eecac9cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f2e7d0>
2025-12-05 17:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_4c8d9d73bdc0c406e0dc9804b77e736c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_4c8d9d73bdc0c406e0dc9804b77e736c.jpg saved to cache
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f4ad0>
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_da0413f1eb51494b15160950f7da7f6a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg saved to cache
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_10c8f553f92a926aa5913c41ee754269.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5cefc377f4eba84139d276219b8d49c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_06e807fa2f0b8ab1bbbbfe0b9d1a2727.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d53ed0>
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_53ba01428ba80d0289f87266eecac9cf.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_53ba01428ba80d0289f87266eecac9cf.jpg saved to cache
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5d00895e56a8a1102e9054b313e29de8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5782d50>
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_10c8f553f92a926aa5913c41ee754269.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_10c8f553f92a926aa5913c41ee754269.jpg saved to cache
2025-12-05 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b4f50>
2025-12-05 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_5cefc377f4eba84139d276219b8d49c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5cefc377f4eba84139d276219b8d49c6.jpg saved to cache
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d96310>
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg saved to cache
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b6f10>
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg saved to cache
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb3ad0>
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_06e807fa2f0b8ab1bbbbfe0b9d1a2727.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_06e807fa2f0b8ab1bbbbfe0b9d1a2727.jpg saved to cache
2025-12-05 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_f1eec5fe2a52090a3d320201f850db7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_39b070c9014d06e35a2a844cfc80a193.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f185d0>
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_5d00895e56a8a1102e9054b313e29de8.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5d00895e56a8a1102e9054b313e29de8.jpg saved to cache
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_14595f7d6cf7e776d068dbc338a0e6ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b1b810>
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_f1eec5fe2a52090a3d320201f850db7f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_f1eec5fe2a52090a3d320201f850db7f.jpg saved to cache
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e50690>
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F84%252F0384eab3316e7c3b3abaaa5d12d28bd5%252Fpa%252FWF59773_39b070c9014d06e35a2a844cfc80a193.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_39b070c9014d06e35a2a844cfc80a193.jpg saved to cache
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e230ddd-5df2-5923-8b92-80d7878d996f
2025-12-05 17:06:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e230ddd-5df2-5923-8b92-80d7878d996f, skipping ID generation
2025-12-05 17:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e230ddd-5df2-5923-8b92-80d7878d996f with scrape type 1
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6e230ddd-5df2-5923-8b92-80d7878d996f from tracking dictionaries
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e230ddd-5df2-5923-8b92-80d7878d996f sending to next pipeline
2025-12-05 17:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e230ddd-5df2-5923-8b92-80d7878d996f, identifier: WF59773
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592e290>
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_8f76ba36a799e7b83089843c3187ac77.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg saved to cache
2025-12-05 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e230ddd-5df2-5923-8b92-80d7878d996f with identifier: WF59773
2025-12-05 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e230ddd-5df2-5923-8b92-80d7878d996f with identifier: WF59773
2025-12-05 17:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6e230ddd-5df2-5923-8b92-80d7878d996f with identifier: WF59773 to the API
2025-12-05 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_39b070c9014d06e35a2a844cfc80a193.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:58:27Z',
'fuel_type': 'diesel',
'id': '6e230ddd-5df2-5923-8b92-80d7878d996f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF59773',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 130265,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_13482f861b4ea13d89853d47098415c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_39b070c9014d06e35a2a844cfc80a193.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_af47c24facfbe4273eee9bb11d9a39b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_a5d8f16c51969c809b917f3687d58213.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_06e807fa2f0b8ab1bbbbfe0b9d1a2727.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3f2d03544e0f7d851a9de0db3d635ee4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_7d941cf0698dad3c7943ae2f9855a472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_9bcf226d01ed1625ea4db9f272c845e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e3290ece47059b7e62076a01f60b22b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e7748830fc0e96f64547d16d4c3c73a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_b757a8ab022e06a7890b2dceb4be1033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_60b3f0651072825d8b9ba0e01c1fecfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5678ee59c24b38b8badf8e8c8f1a1e43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_3c41cd28045a355d9b8537f1b361d23b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_e1d3278799da315d98b00522aec6ddf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_5177a269365e42329f8af975cd077a49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_4baea8130a535d3921485457fd40a190.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_d33e0588106aa0a2c2bc27b22ead35d0.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_302d3e7020cc46ecae35c24dad4cc822.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e230ddd-5df2-5923-8b92-80d7878d996f/6e230ddd-5df2-5923-8b92-80d7878d996f_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/84/0384eab3316e7c3b3abaaa5d12d28bd5/pa/WF59773_1759046fc624d0485fdcb86a8d488c31.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-22',
'seats_number': 7,
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2016}
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF59773%27 HTTP/1.1" 200 None
2025-12-05 17:06:08 [auto1.fr] INFO: Saving data for WF59773: {'created_time': 1764954368.173325, 'last_price_update_time': 1764954368.173336, 'auction_closing_time': 1765040307.0}
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WF59773') HTTP/1.1" 204 0
2025-12-05 17:06:08 [scrapy.extensions.logstats] INFO: Crawled 608 pages (at 25 pages/min), scraped 141 items (at 13 items/min)
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ba265ca6556d6b5ab04f754acf82393d.png> (referer: https://www.auto1.com/)
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7c6da4ddb3997e53695637f23bc19fb9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_795ea40a78caa7c2023c0007ad2c638f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dc7010>
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_14595f7d6cf7e776d068dbc338a0e6ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_14595f7d6cf7e776d068dbc338a0e6ce.jpg saved to cache
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c592f750>
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_8861945bc604be0973c76fa9774365a9.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg saved to cache
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_972b9f2029f4f0f53427e23da2aed906.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:06:08 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:06:08 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:06:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59acd50>
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_15.png HTTP/1.1" 201 0
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_ba265ca6556d6b5ab04f754acf82393d.png') HTTP/1.1" 204 0
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ba265ca6556d6b5ab04f754acf82393d.png saved to cache
2025-12-05 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a21a50>
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_7c6da4ddb3997e53695637f23bc19fb9.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7c6da4ddb3997e53695637f23bc19fb9.jpg saved to cache
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d027d0>
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_795ea40a78caa7c2023c0007ad2c638f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_795ea40a78caa7c2023c0007ad2c638f.jpg saved to cache
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a018ef852d8ea828522524c550fb3579.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_76434a2a9fd869890c1fffe922172395.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_35bba16b9d8faeb0451c17a37355cea7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b19950>
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_972b9f2029f4f0f53427e23da2aed906.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_972b9f2029f4f0f53427e23da2aed906.jpg saved to cache
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ab9410>
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F41%252Fce41b0d370931a1026b3c550c2897b9a%252Fpa%252FVM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg saved to cache
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4ad9fb1-0559-5d30-be9c-a690f2222626
2025-12-05 17:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4ad9fb1-0559-5d30-be9c-a690f2222626, skipping ID generation
2025-12-05 17:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ad9fb1-0559-5d30-be9c-a690f2222626 with scrape type 1
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f4ad9fb1-0559-5d30-be9c-a690f2222626 from tracking dictionaries
2025-12-05 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4ad9fb1-0559-5d30-be9c-a690f2222626 sending to next pipeline
2025-12-05 17:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4ad9fb1-0559-5d30-be9c-a690f2222626, identifier: VM00106
2025-12-05 17:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4ad9fb1-0559-5d30-be9c-a690f2222626 with identifier: VM00106
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4ad9fb1-0559-5d30-be9c-a690f2222626 with identifier: VM00106
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 129466, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm00106', 'expiration_date': '2025-12-06t16:37:40z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'f4ad9fb1-0559-5d30-be9c-a690f2222626', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 107612}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 111377}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 115562}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95395}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 106692}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 99526}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68355}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61209}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57955}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43596}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 122739}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 19707}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 21188}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 22251}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 21243}], 'current_year_diff': 7, 'age_in_months': 94, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 129466}
Failed validating None in schema:
False
On instance:
{'age_in_months': 94,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:37:40z',
'fuel_type': 'petrol',
'id': 'f4ad9fb1-0559-5d30-be9c-a690f2222626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm00106',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 129466,
'odometer_in_km': 129466,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2018}
2025-12-05 17:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: f4ad9fb1-0559-5d30-be9c-a690f2222626 spider: auto1.fr
2025-12-05 17:06:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f4ad9fb1-0559-5d30-be9c-a690f2222626 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 129466, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm00106', 'expiration_date': '2025-12-06t16:37:40z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'f4ad9fb1-0559-5d30-be9c-a690f2222626', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 107612}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 111377}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 115562}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95395}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 106692}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 99526}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68355}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61209}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57955}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43596}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 122739}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 19707}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 21188}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 22251}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 21243}], 'current_year_diff': 7, 'age_in_months': 94, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 129466}
Failed validating None in schema:
False
On instance:
{'age_in_months': 94,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:37:40z',
'fuel_type': 'petrol',
'id': 'f4ad9fb1-0559-5d30-be9c-a690f2222626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm00106',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 129466,
'odometer_in_km': 129466,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:37:40Z',
'fuel_type': 'petrol',
'id': 'f4ad9fb1-0559-5d30-be9c-a690f2222626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM00106',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '208',
'odometer': 129466,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b14213b75e8d9bff074e46fba1cf7dc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7bbcbd667fd6cddaec42fa9faf51d21a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_7f8dc3c4f39c04d2bfadc2c930747d1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_973defc2b9b96b25310373de8e393e0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8861945bc604be0973c76fa9774365a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_8f76ba36a799e7b83089843c3187ac77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_0ff9616d19e4d06cd2fec036254f9de0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_abd7e1d0d1e2ff24e04ac199a22c42d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da0413f1eb51494b15160950f7da7f6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_b6e32b83c13f77866c2d960955946c42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_da7fd9d9a18c7353a83f81914f17150c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_d78fbc0a663a7bb7e3427f6de0de8305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_22c2fe8a6a26ec4820b361c471a893b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aa71950427a498cebb33951985982e2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_aba0bcb8ade47c38c23408ba19d924c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_6ec9d6e73a0a7f97df09508079887dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_61d6a6ecd8ad015f6c388a7bb7573e70.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_ebeaa1b7773943b4542e9165cc90ce64.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_932e8f6a261868504787f276c1243fa4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ad9fb1-0559-5d30-be9c-a690f2222626/f4ad9fb1-0559-5d30-be9c-a690f2222626_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/41/ce41b0d370931a1026b3c550c2897b9a/pa/VM00106_2f3e38c6103a048a0e988b3ff2251983.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM00106%27 HTTP/1.1" 200 None
2025-12-05 17:06:10 [auto1.fr] INFO: Saving data for VM00106: {'created_time': 1764954370.335898, 'last_price_update_time': 1764954370.335907, 'auction_closing_time': 1765039060.0}
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VM00106') HTTP/1.1" 204 0
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_859100c4caca3ed3aa669880875ce69d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ec80c46bbcb4750462eb093baa926c06.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU05475> (referer: https://www.auto1.com/v1/car-details-view/PU05475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5853c90>
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_a018ef852d8ea828522524c550fb3579.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a018ef852d8ea828522524c550fb3579.jpg saved to cache
2025-12-05 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a87dd0>
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_76434a2a9fd869890c1fffe922172395.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_76434a2a9fd869890c1fffe922172395.jpg saved to cache
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d00590>
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_35bba16b9d8faeb0451c17a37355cea7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_35bba16b9d8faeb0451c17a37355cea7.jpg saved to cache
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_527b77a3e7cd846b6ed608bde188c448.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT12965> (referer: https://www.auto1.com/v1/car-details-view/MT12965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a5650>
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_859100c4caca3ed3aa669880875ce69d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_859100c4caca3ed3aa669880875ce69d.jpg saved to cache
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5793c90>
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_ec80c46bbcb4750462eb093baa926c06.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ec80c46bbcb4750462eb093baa926c06.jpg saved to cache
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea09c154-b587-5f9b-9dd7-22d6421e4b21 with identifier: PU05475
2025-12-05 17:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea09c154-b587-5f9b-9dd7-22d6421e4b21 with scrape type 2
2025-12-05 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea09c154-b587-5f9b-9dd7-22d6421e4b21 with scrape type 2
2025-12-05 17:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea09c154-b587-5f9b-9dd7-22d6421e4b21, identifier: PU05475
2025-12-05 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_672465594ce096e6fed2c4a022eff069.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea09c154-b587-5f9b-9dd7-22d6421e4b21 with identifier: PU05475
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea09c154-b587-5f9b-9dd7-22d6421e4b21 with identifier: PU05475
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 41172, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pu05475', 'expiration_date': '2025-12-06t16:34:43z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'ea09c154-b587-5f9b-9dd7-22d6421e4b21', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 41172}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:34:43z',
'fuel_type': 'petrol',
'id': 'ea09c154-b587-5f9b-9dd7-22d6421e4b21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pu05475',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 41172,
'odometer_in_km': 41172,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-05',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: ea09c154-b587-5f9b-9dd7-22d6421e4b21 spider: auto1.fr
2025-12-05 17:06:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ea09c154-b587-5f9b-9dd7-22d6421e4b21 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 41172, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pu05475', 'expiration_date': '2025-12-06t16:34:43z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'ea09c154-b587-5f9b-9dd7-22d6421e4b21', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 41172}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:34:43z',
'fuel_type': 'petrol',
'id': 'ea09c154-b587-5f9b-9dd7-22d6421e4b21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pu05475',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 41172,
'odometer_in_km': 41172,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-05',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:34:43Z',
'fuel_type': 'petrol',
'id': 'ea09c154-b587-5f9b-9dd7-22d6421e4b21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU05475',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 41172,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU05475%27 HTTP/1.1" 200 None
2025-12-05 17:06:12 [auto1.fr] INFO: Saving data for PU05475: {'auction_closing_time': 1765038883.0, 'created_time': 1764782271.388462, 'last_price_update_time': 1764954372.037203}
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU05475') HTTP/1.1" 204 0
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ce088e67c1efbf41ed77a5cf46a737a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF88675> (referer: https://www.auto1.com/v1/car-details-view/WF88675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0fd10>
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_527b77a3e7cd846b6ed608bde188c448.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_527b77a3e7cd846b6ed608bde188c448.jpg saved to cache
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca with identifier: MT12965
2025-12-05 17:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca with scrape type 1
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_62880a9d57bb4d73f2f102aa3fe560de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_62880a9d57bb4d73f2f102aa3fe560de.jpg not downloaded yet
2025-12-05 17:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a78890>
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_672465594ce096e6fed2c4a022eff069.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_672465594ce096e6fed2c4a022eff069.jpg saved to cache
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_1ff788feb4a74d203f75df48adf7aa71.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1ff788feb4a74d203f75df48adf7aa71.jpg not downloaded yet
2025-12-05 17:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a86399e104c5e470126796a2946b1b6b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_f16826d461e9dc9b70daa03b89742d29.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_f16826d461e9dc9b70daa03b89742d29.jpg not downloaded yet
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585ca50>
2025-12-05 17:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_2ce088e67c1efbf41ed77a5cf46a737a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ce088e67c1efbf41ed77a5cf46a737a.jpg saved to cache
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbdc50>
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fe0%252Fbee0872c95314ec52adbb555fb4ef149%252Fpa%252FVD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg saved to cache
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a26e3ea-c662-516f-ae6e-e099b52781e7
2025-12-05 17:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a26e3ea-c662-516f-ae6e-e099b52781e7, skipping ID generation
2025-12-05 17:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a26e3ea-c662-516f-ae6e-e099b52781e7 with scrape type 1
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0a26e3ea-c662-516f-ae6e-e099b52781e7 from tracking dictionaries
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a26e3ea-c662-516f-ae6e-e099b52781e7 sending to next pipeline
2025-12-05 17:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a26e3ea-c662-516f-ae6e-e099b52781e7, identifier: VD63915
2025-12-05 17:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf3369be-d940-558f-97d2-c34ae4ab9601 with identifier: WF88675
2025-12-05 17:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf3369be-d940-558f-97d2-c34ae4ab9601 with scrape type 2
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf3369be-d940-558f-97d2-c34ae4ab9601 with scrape type 2
2025-12-05 17:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf3369be-d940-558f-97d2-c34ae4ab9601, identifier: WF88675
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cc2310>
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg saved to cache
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd5450>
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_29cf494fe9db830603c94979a7a995f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg saved to cache
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_16a1a6629289de547b68ed8bb798b2ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_16a1a6629289de547b68ed8bb798b2ff.jpg not downloaded yet
2025-12-05 17:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a26e3ea-c662-516f-ae6e-e099b52781e7 with identifier: VD63915
2025-12-05 17:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a26e3ea-c662-516f-ae6e-e099b52781e7 with identifier: VD63915
2025-12-05 17:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a26e3ea-c662-516f-ae6e-e099b52781e7 with identifier: VD63915 to the API
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:02:10Z',
'fuel_type': 'electro',
'id': '0a26e3ea-c662-516f-ae6e-e099b52781e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD63915',
'listing': 'auction',
'location': 'FR, Muret',
'make': 'Renault',
'model': 'Zoe',
'odometer': 64500,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2864531,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_c66c23375cafa370b54755013f8f9628.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_9433db05a1ee1a87fad5051b61dc581c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ebce029ef9442637ae6df07b1b2dfc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_2ce088e67c1efbf41ed77a5cf46a737a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_527b77a3e7cd846b6ed608bde188c448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_e33767374fd5b9ecbd7ea3ab70c8afa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_4eb11294996646e3d2f369939f676199.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_b8ffbfe51f43add83a1a1692b259b9b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2907713,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_cb9515800a10f7d200e72180b03254af.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_aa3e494baacee9a3df5c5e8d1e534717.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_859100c4caca3ed3aa669880875ce69d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ec80c46bbcb4750462eb093baa926c06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_84261b3bcbc934d367f992f7078f140d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_76434a2a9fd869890c1fffe922172395.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_972b9f2029f4f0f53427e23da2aed906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a26e3ea-c662-516f-ae6e-e099b52781e7/0a26e3ea-c662-516f-ae6e-e099b52781e7_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 80539,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/e0/bee0872c95314ec52adbb555fb4ef149/pa/VD63915_ba265ca6556d6b5ab04f754acf82393d.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Zoe electric drive 51 kW Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2020}
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD63915%27 HTTP/1.1" 200 None
2025-12-05 17:06:14 [auto1.fr] INFO: Saving data for VD63915: {'created_time': 1764954374.35573, 'last_price_update_time': 1764954374.35574, 'auction_closing_time': 1765036930.0}
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VD63915') HTTP/1.1" 204 0
2025-12-05 17:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf3369be-d940-558f-97d2-c34ae4ab9601 with identifier: WF88675
2025-12-05 17:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf3369be-d940-558f-97d2-c34ae4ab9601 with identifier: WF88675
2025-12-05 17:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf3369be-d940-558f-97d2-c34ae4ab9601 with identifier: WF88675 to the API
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WF88675>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 95,
'expiration_date': '2025-12-06T16:06:32Z',
'fuel_type': 'electro',
'id': 'bf3369be-d940-558f-97d2-c34ae4ab9601',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF88675',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500e',
'odometer': 14447,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 70 kW',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF88675%27 HTTP/1.1" 200 None
2025-12-05 17:06:14 [auto1.fr] INFO: Saving data for WF88675: {'auction_closing_time': 1765037192.0, 'created_time': 1764782179.204296, 'last_price_update_time': 1764954374.684234}
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WF88675') HTTP/1.1" 204 0
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC79503> (referer: https://www.auto1.com/v1/car-details-view/ZC79503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7f036b576d6cbd163dcd79fc48eadd96.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_3e8afb126fabf12c28e3e6ad643a3cdc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_3e8afb126fabf12c28e3e6ad643a3cdc.jpg not downloaded yet
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN63847> (referer: https://www.auto1.com/v1/car-details-view/WN63847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_519878a6d1aae79de23305237630bca3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_337c7c2eedf2b11343f532b459e0373b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_337c7c2eedf2b11343f532b459e0373b.jpg not downloaded yet
2025-12-05 17:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7c151d0>
2025-12-05 17:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_a86399e104c5e470126796a2946b1b6b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a86399e104c5e470126796a2946b1b6b.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5711fefcf5ef7c1891ef54a74db5d0c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_e6b336e7b8a7e83088dfbda24200221b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_e6b336e7b8a7e83088dfbda24200221b.jpg not downloaded yet
2025-12-05 17:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_62880a9d57bb4d73f2f102aa3fe560de.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1ff788feb4a74d203f75df48adf7aa71.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_1b28e7dcfb509900bafbdef009d6aee0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1b28e7dcfb509900bafbdef009d6aee0.jpg not downloaded yet
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d969d0>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165afd47-21c4-5f10-9959-6ec282e59818 with identifier: ZC79503
2025-12-05 17:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165afd47-21c4-5f10-9959-6ec282e59818 with scrape type 1
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_6e4723ef59ec141fe95e2212eb9ba0aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6e4723ef59ec141fe95e2212eb9ba0aa.jpg not downloaded yet
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b3350>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7f036b576d6cbd163dcd79fc48eadd96.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7f036b576d6cbd163dcd79fc48eadd96.jpg saved to cache
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8eea424-6a92-5e56-9705-1e87a5504cd8 with identifier: WN63847
2025-12-05 17:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8eea424-6a92-5e56-9705-1e87a5504cd8 with scrape type 1
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg not downloaded yet
2025-12-05 17:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1f0d0>
2025-12-05 17:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_519878a6d1aae79de23305237630bca3.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_519878a6d1aae79de23305237630bca3.jpg saved to cache
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_357454b454715e93a16dcaef734b695c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_357454b454715e93a16dcaef734b695c.jpg not downloaded yet
2025-12-05 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_3e8afb126fabf12c28e3e6ad643a3cdc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7bcd307d8276436e0a4790697af4b394.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_e8faea6cd0504736793b2488625b8ce4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_e8faea6cd0504736793b2488625b8ce4.jpg not downloaded yet
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_74897c58e671124cacb8255a15e3d619.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg not downloaded yet
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg not downloaded yet
2025-12-05 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY92561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM80539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ60998> (referer: https://www.auto1.com/v1/car-details-view/PZ60998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg not downloaded yet
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_062fe5f536f4d45eb2ac9f308708752a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg not downloaded yet
2025-12-05 17:06:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdda50>
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_5711fefcf5ef7c1891ef54a74db5d0c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5711fefcf5ef7c1891ef54a74db5d0c5.jpg saved to cache
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cad210>
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_62880a9d57bb4d73f2f102aa3fe560de.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_62880a9d57bb4d73f2f102aa3fe560de.jpg saved to cache
2025-12-05 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b24c50>
2025-12-05 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_1ff788feb4a74d203f75df48adf7aa71.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1ff788feb4a74d203f75df48adf7aa71.jpg saved to cache
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_016770401ecf8e77c681675c0861bca7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_016770401ecf8e77c681675c0861bca7.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_f6621ad3ef1544e167d8b36850e5ce66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_f6621ad3ef1544e167d8b36850e5ce66.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_076b5399f919ebe2afa1c8c1837fe3ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_076b5399f919ebe2afa1c8c1837fe3ae.jpg not downloaded yet
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK44167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_1d3f922fe828a159997088b1d1323d90.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1d3f922fe828a159997088b1d1323d90.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_f4236b64dc5722fedd4d9372115d5aed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg not downloaded yet
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_38dacb7e9e39f3cff7591e3416783b00.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_357454b454715e93a16dcaef734b695c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_fa95d76ae58910e4bdc0d48193252ed1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_fa95d76ae58910e4bdc0d48193252ed1.jpg not downloaded yet
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3c550>
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_3e8afb126fabf12c28e3e6ad643a3cdc.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_3e8afb126fabf12c28e3e6ad643a3cdc.jpg saved to cache
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c31d0>
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7bcd307d8276436e0a4790697af4b394.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7bcd307d8276436e0a4790697af4b394.jpg saved to cache
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f30d15-c789-5be7-ad0a-079d752c0b28 with identifier: PZ60998
2025-12-05 17:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f30d15-c789-5be7-ad0a-079d752c0b28 with scrape type 1
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_89d0e18d482674bf72fb26690cc9385a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_89d0e18d482674bf72fb26690cc9385a.jpg not downloaded yet
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_657cc2836991fc5453575d37e09d5fbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_657cc2836991fc5453575d37e09d5fbc.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_8ee05494c86cf5fcced2df805923d5c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_8ee05494c86cf5fcced2df805923d5c6.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_573f4d2e897981599205e93dfaf45642.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_573f4d2e897981599205e93dfaf45642.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_b60cadf38411d9e66d56382a88dee792.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b60cadf38411d9e66d56382a88dee792.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg not downloaded yet
2025-12-05 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6e4723ef59ec141fe95e2212eb9ba0aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_314d9fbfa15dcae312203c166b028a64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_314d9fbfa15dcae312203c166b028a64.jpg not downloaded yet
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_59eac250f57c37287d481bd81d48626d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_59eac250f57c37287d481bd81d48626d.jpg not downloaded yet
2025-12-05 17:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d131d0>
2025-12-05 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ffb%252F73fb4d54b8d36254542af95743b849f6%252Fpa%252FBY34409_38dacb7e9e39f3cff7591e3416783b00.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_38dacb7e9e39f3cff7591e3416783b00.jpg saved to cache
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6718eaa-9efe-519e-9722-92529cfc3c2f
2025-12-05 17:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6718eaa-9efe-519e-9722-92529cfc3c2f, skipping ID generation
2025-12-05 17:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6718eaa-9efe-519e-9722-92529cfc3c2f with scrape type 1
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f6718eaa-9efe-519e-9722-92529cfc3c2f from tracking dictionaries
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6718eaa-9efe-519e-9722-92529cfc3c2f sending to next pipeline
2025-12-05 17:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f6718eaa-9efe-519e-9722-92529cfc3c2f, identifier: BY34409
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b5690>
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_357454b454715e93a16dcaef734b695c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_357454b454715e93a16dcaef734b695c.jpg saved to cache
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_8b06cd444dc7323f19ec58aac543cd84.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_8b06cd444dc7323f19ec58aac543cd84.jpg not downloaded yet
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg not downloaded yet
2025-12-05 17:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409
2025-12-05 17:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409
2025-12-05 17:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409 to the API
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_38dacb7e9e39f3cff7591e3416783b00.jpg>
{'auction_title': '',
'c_o_2_emission_value': 79,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 381,
'expiration_date': '2025-12-06T16:10:03Z',
'fuel_type': 'hybrid',
'id': 'f6718eaa-9efe-519e-9722-92529cfc3c2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY34409',
'listing': 'auction',
'location': 'FR, Nîmes',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 47427,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2612105,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_38dacb7e9e39f3cff7591e3416783b00.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_795ea40a78caa7c2023c0007ad2c638f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2277058,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_519878a6d1aae79de23305237630bca3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2460934,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a86399e104c5e470126796a2946b1b6b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_f1eec5fe2a52090a3d320201f850db7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_10c8f553f92a926aa5913c41ee754269.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2180823,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_c088e526d2f003a8c2e95de3cba235a2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_4c8d9d73bdc0c406e0dc9804b77e736c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2668151,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_a018ef852d8ea828522524c550fb3579.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_46e144d6b791be27e9a075baeabc50ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2499900,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_71c70493f1615417e79b12d72697204b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2360724,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_1b2dd7e957186cb94b05823dedce18bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_3920a58b566715a81d1a310735ff5a62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2344259,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_14595f7d6cf7e776d068dbc338a0e6ce.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_6729e74f314980e787365b411c05307e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6718eaa-9efe-519e-9722-92529cfc3c2f/f6718eaa-9efe-519e-9722-92529cfc3c2f_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 76797,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img73/fb/73fb4d54b8d36254542af95743b849f6/pa/BY34409_50c5fa82c76b1dd586567226d16b4129.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2021}
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY34409%27 HTTP/1.1" 200 None
2025-12-05 17:06:19 [auto1.fr] INFO: Saving data for BY34409: {'created_time': 1764954379.33831, 'last_price_update_time': 1764954379.33832, 'auction_closing_time': 1765037403.0}
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BY34409') HTTP/1.1" 204 0
2025-12-05 17:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_e6b336e7b8a7e83088dfbda24200221b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_c35e90e0fdeec1732c4bed94c224a916.png%27 HTTP/1.1" 200 None
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_c35e90e0fdeec1732c4bed94c224a916.png not downloaded yet
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_3d9abd676b92d8df5a07bad1f28864f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3d9abd676b92d8df5a07bad1f28864f7.jpg not downloaded yet
2025-12-05 17:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1b28e7dcfb509900bafbdef009d6aee0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_bd372c1887566d11748301a18152ac56.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_bd372c1887566d11748301a18152ac56.jpg not downloaded yet
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg not downloaded yet
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf2a10>
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg saved to cache
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf1dd0>
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_6e4723ef59ec141fe95e2212eb9ba0aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6e4723ef59ec141fe95e2212eb9ba0aa.jpg saved to cache
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg not downloaded yet
2025-12-05 17:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT42696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_1b5f3737f414ae65c3bc00e8718d12ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1b5f3737f414ae65c3bc00e8718d12ec.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_4c5b40dded6b2d9dbb229c4d5c4442df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_4c5b40dded6b2d9dbb229c4d5c4442df.jpg not downloaded yet
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e332d0>
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_e6b336e7b8a7e83088dfbda24200221b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_e6b336e7b8a7e83088dfbda24200221b.jpg saved to cache
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e77350>
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_1b28e7dcfb509900bafbdef009d6aee0.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1b28e7dcfb509900bafbdef009d6aee0.jpg saved to cache
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_e8faea6cd0504736793b2488625b8ce4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_b150d802841de1acaa897b6eb1d7be82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b150d802841de1acaa897b6eb1d7be82.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_702de6588269e66ba0ab3e7499bb8803.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg not downloaded yet
2025-12-05 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_337c7c2eedf2b11343f532b459e0373b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_ee950c53838f923cc57dd1afe66927d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ee950c53838f923cc57dd1afe66927d6.jpg not downloaded yet
2025-12-05 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7f57bfe62c422548448bdbf27217d024.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_6bccd1caff2666d0a65f3513c7c2d8fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6bccd1caff2666d0a65f3513c7c2d8fc.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_508705d45595dec7276cf56ee8a4b36f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_d3c9ac3ae4a361c31b43041d0f49f130.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_d3c9ac3ae4a361c31b43041d0f49f130.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_3250a59153032b0bee75df25ad173dd1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_3250a59153032b0bee75df25ad173dd1.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_ab797141b024a1d785487ba484286702.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg not downloaded yet
2025-12-05 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_ffcad21992040e16eefccd62829f6229.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ffcad21992040e16eefccd62829f6229.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_954866c066509514bd5de3890500615f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_954866c066509514bd5de3890500615f.jpg not downloaded yet
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_499f43c8c0a0587a799cad2612886689.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg not downloaded yet
2025-12-05 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_54d84e9522355576f982c0eecbb3495f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_54d84e9522355576f982c0eecbb3495f.jpg not downloaded yet
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578c410>
2025-12-05 17:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_e8faea6cd0504736793b2488625b8ce4.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_e8faea6cd0504736793b2488625b8ce4.jpg saved to cache
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da8cd0>
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_337c7c2eedf2b11343f532b459e0373b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_337c7c2eedf2b11343f532b459e0373b.jpg saved to cache
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_0999ec1c2721fb3aad7424f9bc3ec61c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_0999ec1c2721fb3aad7424f9bc3ec61c.jpg not downloaded yet
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg not downloaded yet
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_f6621ad3ef1544e167d8b36850e5ce66.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_3fa1ee195f5363fdd41fb6e446182d41.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3fa1ee195f5363fdd41fb6e446182d41.jpg not downloaded yet
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_89d0e18d482674bf72fb26690cc9385a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_076b5399f919ebe2afa1c8c1837fe3ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_1adc8bb7d271f21da5dc51c078d461dc.png%27 HTTP/1.1" 200 None
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1adc8bb7d271f21da5dc51c078d461dc.png not downloaded yet
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_ae03b8396a51412d2ce8a6e281892d84.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg not downloaded yet
2025-12-05 17:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c784bad0>
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fcf%252Fc4cfe3c4352b87cfa168e9b5afa7b41e%252Fpa%252FRF17814_7f57bfe62c422548448bdbf27217d024.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7f57bfe62c422548448bdbf27217d024.jpg saved to cache
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08535020-0c03-53ab-8c63-d27554355edf
2025-12-05 17:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08535020-0c03-53ab-8c63-d27554355edf, skipping ID generation
2025-12-05 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08535020-0c03-53ab-8c63-d27554355edf with scrape type 1
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08535020-0c03-53ab-8c63-d27554355edf from tracking dictionaries
2025-12-05 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08535020-0c03-53ab-8c63-d27554355edf sending to next pipeline
2025-12-05 17:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08535020-0c03-53ab-8c63-d27554355edf, identifier: RF17814
2025-12-05 17:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d6ed10>
2025-12-05 17:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff862a27af159d675475c9281875a1957%252Fpa%252FRH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg saved to cache
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99
2025-12-05 17:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99, skipping ID generation
2025-12-05 17:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 with scrape type 1
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 from tracking dictionaries
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 sending to next pipeline
2025-12-05 17:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99, identifier: RH76441
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f6ad0>
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg saved to cache
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_573f4d2e897981599205e93dfaf45642.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_9f6d90c089e5521b95a61c3a9e63516d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_9f6d90c089e5521b95a61c3a9e63516d.jpg not downloaded yet
2025-12-05 17:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08535020-0c03-53ab-8c63-d27554355edf with identifier: RF17814
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08535020-0c03-53ab-8c63-d27554355edf with identifier: RF17814
2025-12-05 17:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08535020-0c03-53ab-8c63-d27554355edf with identifier: RF17814 to the API
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7f57bfe62c422548448bdbf27217d024.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:46:25Z',
'fuel_type': 'diesel',
'id': '08535020-0c03-53ab-8c63-d27554355edf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF17814',
'listing': 'auction',
'location': 'FR, Échirolles',
'make': 'Peugeot',
'model': '2008',
'odometer': 70372,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_9568978e8ed012005d0feabc0b186e18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_3b92a93921a65c51876354828d1862ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_98c1cc30203f7d91479af1836b783bb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_099efa849e4655992e4b5dce25211aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3100388,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7f57bfe62c422548448bdbf27217d024.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150212,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_200246f9f5db505cfb61f5775b27527f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_35bba16b9d8faeb0451c17a37355cea7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_4203ce38ef81499cc58b41270512e14f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_7c6da4ddb3997e53695637f23bc19fb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2973706,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5711fefcf5ef7c1891ef54a74db5d0c5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5d00895e56a8a1102e9054b313e29de8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_5cefc377f4eba84139d276219b8d49c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_53ba01428ba80d0289f87266eecac9cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3108449,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_672465594ce096e6fed2c4a022eff069.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_ff6349c4fe1effa62a5ac28602551ef8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08535020-0c03-53ab-8c63-d27554355edf/08535020-0c03-53ab-8c63-d27554355edf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/cf/c4cfe3c4352b87cfa168e9b5afa7b41e/pa/RF17814_f4f0c98f192da47eeac45dfd9814e808.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-01',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF17814%27 HTTP/1.1" 200 None
2025-12-05 17:06:22 [auto1.fr] INFO: Saving data for RF17814: {'created_time': 1764954382.929832, 'last_price_update_time': 1764954382.929843, 'auction_closing_time': 1765039585.0}
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RF17814') HTTP/1.1" 204 0
2025-12-05 17:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 with identifier: RH76441
2025-12-05 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 with identifier: RH76441
2025-12-05 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'automatic', 'odometer': 81183, 'odometer_reading_unit': 'km', 'registration_date': '2018-09-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh76441', 'expiration_date': '2025-12-06t16:48:09z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, bourgoin jallieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '4138bf64-ac27-559f-9ee9-7e4d30cf3b99', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2501725}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64365}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62911}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50823}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2507369}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73350}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2439372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70397}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2624860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2779535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3222698}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2544340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94971}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 85737}], 'current_year_diff': 7, 'age_in_months': 86, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 81183}
Failed validating None in schema:
False
On instance:
{'age_in_months': 86,
'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:48:09z',
'fuel_type': 'petrol',
'id': '4138bf64-ac27-559f-9ee9-7e4d30cf3b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh76441',
'listing': 'auction',
'location': 'fr, bourgoin jallieu',
'make': 'citroen',
'make_model': 'citroen c4 cactus',
'model': 'c4 cactus',
'odometer': 81183,
'odometer_in_km': 81183,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2501725,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507369,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439372,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2624860,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779535,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3222698,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2544340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 85737,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-23',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 cactus 1.2 e-thp shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2018}
2025-12-05 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 spider: auto1.fr
2025-12-05 17:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4138bf64-ac27-559f-9ee9-7e4d30cf3b99 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'automatic', 'odometer': 81183, 'odometer_reading_unit': 'km', 'registration_date': '2018-09-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh76441', 'expiration_date': '2025-12-06t16:48:09z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, bourgoin jallieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '4138bf64-ac27-559f-9ee9-7e4d30cf3b99', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2501725}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64365}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62911}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50823}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2507369}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73350}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2439372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70397}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2624860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2779535}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3222698}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2544340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94971}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 85737}], 'current_year_diff': 7, 'age_in_months': 86, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 81183}
Failed validating None in schema:
False
On instance:
{'age_in_months': 86,
'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:48:09z',
'fuel_type': 'petrol',
'id': '4138bf64-ac27-559f-9ee9-7e4d30cf3b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh76441',
'listing': 'auction',
'location': 'fr, bourgoin jallieu',
'make': 'citroen',
'make_model': 'citroen c4 cactus',
'model': 'c4 cactus',
'odometer': 81183,
'odometer_in_km': 81183,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2501725,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507369,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439372,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2624860,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779535,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3222698,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2544340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 85737,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-23',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c4 cactus 1.2 e-thp shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:48:09Z',
'fuel_type': 'petrol',
'id': '4138bf64-ac27-559f-9ee9-7e4d30cf3b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH76441',
'listing': 'auction',
'location': 'FR, Bourgoin Jallieu',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 81183,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2501725,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_f8ce1c61f6727cda3e5b3cd814b0ce6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7b73d395d5d8deefbb10cf1dda916e7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_29cf494fe9db830603c94979a7a995f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_9eb7e12cf5bd640f7db00d763b4cee05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507369,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_0b9c0cbb9d97dfb8c261d17ad8f6ac94.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_dc4f1fbf4a030271bb48f9c17a9e3f28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439372,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_08b68ce63baf4049ccc46681543f9938.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_876534d7ab1bca804901640a1c01cff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6740f9b0c859815ce9326b34762f7136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2624860,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_88419ffb718b4e25a9813428f1a44ac0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2779535,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_7cdcf0d09449054fb66f02fd3c4213f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3222698,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_c4be9af211aa1ebe2269255baa9c74ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_652c6f52f3c9725c5b324f72b244ff61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2544340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_6f1f71c54c94aeacbe13549e3ee8b0b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_a7e680fa8d6a640f610239eaee854e4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4138bf64-ac27-559f-9ee9-7e4d30cf3b99/4138bf64-ac27-559f-9ee9-7e4d30cf3b99_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 85737,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f862a27af159d675475c9281875a1957/pa/RH76441_e37a3190b663284a2c9d333794aebe6f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-23',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2018}
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH76441%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [auto1.fr] INFO: Saving data for RH76441: {'created_time': 1764954383.184884, 'last_price_update_time': 1764954383.184892, 'auction_closing_time': 1765039689.0}
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RH76441') HTTP/1.1" 204 0
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7dff632a52b57cdc0e7d7f4596cd8a7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_16a1a6629289de547b68ed8bb798b2ff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_c0801c51f615dca5bc32f91a7bc8840f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_c0801c51f615dca5bc32f91a7bc8840f.jpg not downloaded yet
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c599a1d0>
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_f6621ad3ef1544e167d8b36850e5ce66.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_f6621ad3ef1544e167d8b36850e5ce66.jpg saved to cache
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dc67d0>
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_89d0e18d482674bf72fb26690cc9385a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_89d0e18d482674bf72fb26690cc9385a.jpg saved to cache
2025-12-05 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a67dd0>
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_076b5399f919ebe2afa1c8c1837fe3ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_076b5399f919ebe2afa1c8c1837fe3ae.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_8b06cd444dc7323f19ec58aac543cd84.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_f16826d461e9dc9b70daa03b89742d29.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_a42be6e6e1694e282d3d3ff3b79c791c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_a42be6e6e1694e282d3d3ff3b79c791c.jpg not downloaded yet
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c674c790>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_573f4d2e897981599205e93dfaf45642.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_573f4d2e897981599205e93dfaf45642.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f2a10>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_7dff632a52b57cdc0e7d7f4596cd8a7e.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7dff632a52b57cdc0e7d7f4596cd8a7e.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a94990>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_16a1a6629289de547b68ed8bb798b2ff.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_16a1a6629289de547b68ed8bb798b2ff.jpg saved to cache
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b150d802841de1acaa897b6eb1d7be82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_cb4297f3f73d55c4c7285d07635ded92.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_cb4297f3f73d55c4c7285d07635ded92.jpg not downloaded yet
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c588e090>
2025-12-05 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg saved to cache
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c78757d0>
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_8b06cd444dc7323f19ec58aac543cd84.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_8b06cd444dc7323f19ec58aac543cd84.jpg saved to cache
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ad3d0>
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_f16826d461e9dc9b70daa03b89742d29.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_f16826d461e9dc9b70daa03b89742d29.jpg saved to cache
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_5619472927e19b977080f48195657f2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_5619472927e19b977080f48195657f2e.jpg not downloaded yet
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d5e750>
2025-12-05 17:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f04150>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_b150d802841de1acaa897b6eb1d7be82.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b150d802841de1acaa897b6eb1d7be82.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_9f6d90c089e5521b95a61c3a9e63516d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_c0801c51f615dca5bc32f91a7bc8840f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_a42be6e6e1694e282d3d3ff3b79c791c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_cb4297f3f73d55c4c7285d07635ded92.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1adc8bb7d271f21da5dc51c078d461dc.png> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_54d84e9522355576f982c0eecbb3495f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_954866c066509514bd5de3890500615f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5934ed0>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_9f6d90c089e5521b95a61c3a9e63516d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_9f6d90c089e5521b95a61c3a9e63516d.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_3250a59153032b0bee75df25ad173dd1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3fa1ee195f5363fdd41fb6e446182d41.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_5619472927e19b977080f48195657f2e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dac790>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_ae03b8396a51412d2ce8a6e281892d84.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg saved to cache
2025-12-05 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a96a90>
2025-12-05 17:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_c0801c51f615dca5bc32f91a7bc8840f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_c0801c51f615dca5bc32f91a7bc8840f.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f184d0>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_a42be6e6e1694e282d3d3ff3b79c791c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_a42be6e6e1694e282d3d3ff3b79c791c.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d41d0>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_cb4297f3f73d55c4c7285d07635ded92.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_cb4297f3f73d55c4c7285d07635ded92.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ffcad21992040e16eefccd62829f6229.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_0999ec1c2721fb3aad7424f9bc3ec61c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_d3c9ac3ae4a361c31b43041d0f49f130.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c77150>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_74897c58e671124cacb8255a15e3d619.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg saved to cache
2025-12-05 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5976990>
2025-12-05 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg saved to cache
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c76950>
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_702de6588269e66ba0ab3e7499bb8803.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg saved to cache
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f1410>
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_15.png HTTP/1.1" 201 0
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_1adc8bb7d271f21da5dc51c078d461dc.png') HTTP/1.1" 204 0
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1adc8bb7d271f21da5dc51c078d461dc.png saved to cache
2025-12-05 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cb9d0>
2025-12-05 17:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg saved to cache
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da8490>
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_54d84e9522355576f982c0eecbb3495f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_54d84e9522355576f982c0eecbb3495f.jpg saved to cache
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dabd50>
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_ab797141b024a1d785487ba484286702.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg saved to cache
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5970290>
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_954866c066509514bd5de3890500615f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_954866c066509514bd5de3890500615f.jpg saved to cache
2025-12-05 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a66dd0>
2025-12-05 17:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_3250a59153032b0bee75df25ad173dd1.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_3250a59153032b0bee75df25ad173dd1.jpg saved to cache
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c674c0d0>
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_3fa1ee195f5363fdd41fb6e446182d41.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3fa1ee195f5363fdd41fb6e446182d41.jpg saved to cache
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cc2610>
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_5619472927e19b977080f48195657f2e.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_5619472927e19b977080f48195657f2e.jpg saved to cache
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d08390>
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_ffcad21992040e16eefccd62829f6229.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ffcad21992040e16eefccd62829f6229.jpg saved to cache
2025-12-05 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57e6410>
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_0999ec1c2721fb3aad7424f9bc3ec61c.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_0999ec1c2721fb3aad7424f9bc3ec61c.jpg saved to cache
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b49110>
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_d3c9ac3ae4a361c31b43041d0f49f130.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_d3c9ac3ae4a361c31b43041d0f49f130.jpg saved to cache
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_4c5b40dded6b2d9dbb229c4d5c4442df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6bccd1caff2666d0a65f3513c7c2d8fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_59eac250f57c37287d481bd81d48626d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1da90>
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_499f43c8c0a0587a799cad2612886689.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg saved to cache
2025-12-05 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b60cadf38411d9e66d56382a88dee792.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_bd372c1887566d11748301a18152ac56.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1b5f3737f414ae65c3bc00e8718d12ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7919410>
2025-12-05 17:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_508705d45595dec7276cf56ee8a4b36f.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg saved to cache
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3d9abd676b92d8df5a07bad1f28864f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ee950c53838f923cc57dd1afe66927d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_c35e90e0fdeec1732c4bed94c224a916.png> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_314d9fbfa15dcae312203c166b028a64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT42696> (referer: https://www.auto1.com/v1/car-details-view/HT42696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbb790>
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_4c5b40dded6b2d9dbb229c4d5c4442df.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_4c5b40dded6b2d9dbb229c4d5c4442df.jpg saved to cache
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5782290>
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_6bccd1caff2666d0a65f3513c7c2d8fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6bccd1caff2666d0a65f3513c7c2d8fc.jpg saved to cache
2025-12-05 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d13dd0>
2025-12-05 17:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_59eac250f57c37287d481bd81d48626d.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_59eac250f57c37287d481bd81d48626d.jpg saved to cache
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a9f2d0>
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg saved to cache
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK44167> (referer: https://www.auto1.com/v1/car-details-view/AK44167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c595a4d0>
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_b60cadf38411d9e66d56382a88dee792.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b60cadf38411d9e66d56382a88dee792.jpg saved to cache
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e49350>
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_bd372c1887566d11748301a18152ac56.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_bd372c1887566d11748301a18152ac56.jpg saved to cache
2025-12-05 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ddf50>
2025-12-05 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_1b5f3737f414ae65c3bc00e8718d12ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1b5f3737f414ae65c3bc00e8718d12ec.jpg saved to cache
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_657cc2836991fc5453575d37e09d5fbc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1d3f922fe828a159997088b1d1323d90.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_fa95d76ae58910e4bdc0d48193252ed1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_8ee05494c86cf5fcced2df805923d5c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e1750>
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_3d9abd676b92d8df5a07bad1f28864f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3d9abd676b92d8df5a07bad1f28864f7.jpg saved to cache
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5893150>
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_ee950c53838f923cc57dd1afe66927d6.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ee950c53838f923cc57dd1afe66927d6.jpg saved to cache
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5891d90>
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fec%252Ff1ece05f17e6ee8efa0e0172c699ea11%252Fpa%252FPZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg saved to cache
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6f30d15-c789-5be7-ad0a-079d752c0b28
2025-12-05 17:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6f30d15-c789-5be7-ad0a-079d752c0b28, skipping ID generation
2025-12-05 17:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f30d15-c789-5be7-ad0a-079d752c0b28 with scrape type 1
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d6f30d15-c789-5be7-ad0a-079d752c0b28 from tracking dictionaries
2025-12-05 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6f30d15-c789-5be7-ad0a-079d752c0b28 sending to next pipeline
2025-12-05 17:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d6f30d15-c789-5be7-ad0a-079d752c0b28, identifier: PZ60998
2025-12-05 17:06:35 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:06:35 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:06:35 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:06:35 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b4bad0>
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_15.png HTTP/1.1" 201 0
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_c35e90e0fdeec1732c4bed94c224a916.png') HTTP/1.1" 204 0
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_c35e90e0fdeec1732c4bed94c224a916.png saved to cache
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58eff50>
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_314d9fbfa15dcae312203c166b028a64.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_314d9fbfa15dcae312203c166b028a64.jpg saved to cache
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807e830b-c95e-5245-ab3d-959531fb3685 with identifier: HT42696
2025-12-05 17:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807e830b-c95e-5245-ab3d-959531fb3685 with scrape type 2
2025-12-05 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 807e830b-c95e-5245-ab3d-959531fb3685 with scrape type 2
2025-12-05 17:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 807e830b-c95e-5245-ab3d-959531fb3685, identifier: HT42696
2025-12-05 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d6f30d15-c789-5be7-ad0a-079d752c0b28 with identifier: PZ60998
2025-12-05 17:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d6f30d15-c789-5be7-ad0a-079d752c0b28 with identifier: PZ60998
2025-12-05 17:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d6f30d15-c789-5be7-ad0a-079d752c0b28 with identifier: PZ60998 to the API
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 5,
'category': 'Taxi',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:36:11Z',
'fuel_type': 'electro',
'id': 'd6f30d15-c789-5be7-ad0a-079d752c0b28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ60998',
'listing': 'auction',
'location': 'FR, Cabriès',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 78609,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_89d0e18d482674bf72fb26690cc9385a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_573f4d2e897981599205e93dfaf45642.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_59eac250f57c37287d481bd81d48626d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3d9abd676b92d8df5a07bad1f28864f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_97ebbdd657c92c947a47b515c9303ca0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_4c5b40dded6b2d9dbb229c4d5c4442df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ee950c53838f923cc57dd1afe66927d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_d3c9ac3ae4a361c31b43041d0f49f130.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_ffcad21992040e16eefccd62829f6229.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_54d84e9522355576f982c0eecbb3495f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_3fa1ee195f5363fdd41fb6e446182d41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_9f6d90c089e5521b95a61c3a9e63516d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_c0801c51f615dca5bc32f91a7bc8840f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_a42be6e6e1694e282d3d3ff3b79c791c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_cb4297f3f73d55c4c7285d07635ded92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f30d15-c789-5be7-ad0a-079d752c0b28/d6f30d15-c789-5be7-ad0a-079d752c0b28_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ec/f1ece05f17e6ee8efa0e0172c699ea11/pa/PZ60998_5619472927e19b977080f48195657f2e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona electric drive 100 kW Intuitive 2WD',
'transmission': 'automatic',
'trim': 'Intuitive 2WD',
'year': 2022}
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ60998%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.fr] INFO: Saving data for PZ60998: {'created_time': 1764954396.472011, 'last_price_update_time': 1764954396.47202, 'auction_closing_time': 1765038971.0}
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ60998') HTTP/1.1" 204 0
2025-12-05 17:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 807e830b-c95e-5245-ab3d-959531fb3685 with identifier: HT42696
2025-12-05 17:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 807e830b-c95e-5245-ab3d-959531fb3685 with identifier: HT42696
2025-12-05 17:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 28808, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht42696', 'expiration_date': '2025-12-06t16:41:31z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '807e830b-c95e-5245-ab3d-959531fb3685', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 28808}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'beige',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:41:31z',
'fuel_type': 'petrol',
'id': '807e830b-c95e-5245-ab3d-959531fb3685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht42696',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 28808,
'odometer_in_km': 28808,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-30',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2023}
2025-12-05 17:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 807e830b-c95e-5245-ab3d-959531fb3685 spider: auto1.fr
2025-12-05 17:06:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 807e830b-c95e-5245-ab3d-959531fb3685 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 28808, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht42696', 'expiration_date': '2025-12-06t16:41:31z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '807e830b-c95e-5245-ab3d-959531fb3685', 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 28808}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'beige',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:41:31z',
'fuel_type': 'petrol',
'id': '807e830b-c95e-5245-ab3d-959531fb3685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht42696',
'listing': 'auction',
'location': 'fr',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 28808,
'odometer_in_km': 28808,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-30',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech c-series',
'transmission': 'manual',
'trim': 'c-series',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:41:31Z',
'fuel_type': 'petrol',
'id': '807e830b-c95e-5245-ab3d-959531fb3685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT42696',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 28808,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech C-Series',
'transmission': 'manual',
'trim': 'C-Series',
'year': 2023}
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT42696%27 HTTP/1.1" 200 None
2025-12-05 17:06:36 [auto1.fr] INFO: Saving data for HT42696: {'auction_closing_time': 1765039291.0, 'created_time': 1764782101.518658, 'last_price_update_time': 1764954396.699192}
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT42696') HTTP/1.1" 204 0
2025-12-05 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8575330-d29b-5832-ade4-1137b21a79a5 with identifier: AK44167
2025-12-05 17:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8575330-d29b-5832-ade4-1137b21a79a5 with scrape type 2
2025-12-05 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8575330-d29b-5832-ade4-1137b21a79a5 with scrape type 2
2025-12-05 17:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8575330-d29b-5832-ade4-1137b21a79a5, identifier: AK44167
2025-12-05 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8575330-d29b-5832-ade4-1137b21a79a5 with identifier: AK44167
2025-12-05 17:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8575330-d29b-5832-ade4-1137b21a79a5 with identifier: AK44167
2025-12-05 17:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b8575330-d29b-5832-ade4-1137b21a79a5 with identifier: AK44167 to the API
2025-12-05 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AK44167>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2025-12-06T16:13:57Z',
'fuel_type': 'petrol',
'id': 'b8575330-d29b-5832-ade4-1137b21a79a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK44167',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 17136,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Cult',
'transmission': 'manual',
'trim': 'Cult',
'year': 2022}
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK44167%27 HTTP/1.1" 200 None
2025-12-05 17:06:38 [auto1.fr] INFO: Saving data for AK44167: {'auction_closing_time': 1765037637.0, 'created_time': 1764782206.796135, 'last_price_update_time': 1764954398.012011}
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK44167') HTTP/1.1" 204 0
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c1cced6ab8dc6ba09387ed1003726a30.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_aaef3afc10a0626795e95e38ebdf5499.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4deeb50>
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_657cc2836991fc5453575d37e09d5fbc.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_657cc2836991fc5453575d37e09d5fbc.jpg saved to cache
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578eb10>
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_1d3f922fe828a159997088b1d1323d90.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1d3f922fe828a159997088b1d1323d90.jpg saved to cache
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578d650>
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_fa95d76ae58910e4bdc0d48193252ed1.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_fa95d76ae58910e4bdc0d48193252ed1.jpg saved to cache
2025-12-05 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a93250>
2025-12-05 17:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_8ee05494c86cf5fcced2df805923d5c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_8ee05494c86cf5fcced2df805923d5c6.jpg saved to cache
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_3c662b6535177825ac6da32ac138cfb7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM80539> (referer: https://www.auto1.com/v1/car-details-view/VM80539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV76318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY92561> (referer: https://www.auto1.com/v1/car-details-view/VY92561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX95434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f51d0>
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_062fe5f536f4d45eb2ac9f308708752a.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg saved to cache
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a7610>
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbb%252F68bb679f412c60c3b3db78dff6e48fb7%252Fpa%252FZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg saved to cache
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 165afd47-21c4-5f10-9959-6ec282e59818
2025-12-05 17:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 165afd47-21c4-5f10-9959-6ec282e59818, skipping ID generation
2025-12-05 17:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165afd47-21c4-5f10-9959-6ec282e59818 with scrape type 1
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 165afd47-21c4-5f10-9959-6ec282e59818 from tracking dictionaries
2025-12-05 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 165afd47-21c4-5f10-9959-6ec282e59818 sending to next pipeline
2025-12-05 17:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 165afd47-21c4-5f10-9959-6ec282e59818, identifier: ZC79503
2025-12-05 17:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 165afd47-21c4-5f10-9959-6ec282e59818 with identifier: ZC79503
2025-12-05 17:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 165afd47-21c4-5f10-9959-6ec282e59818 with identifier: ZC79503
2025-12-05 17:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 165afd47-21c4-5f10-9959-6ec282e59818 with identifier: ZC79503 to the API
2025-12-05 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:20:04Z',
'fuel_type': 'petrol',
'id': '165afd47-21c4-5f10-9959-6ec282e59818',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC79503',
'listing': 'auction',
'location': 'FR, Escaudain',
'make': 'BMW',
'model': '1er',
'odometer': 84360,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6e4723ef59ec141fe95e2212eb9ba0aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_e8faea6cd0504736793b2488625b8ce4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_abd8cd514fd35976bdbf6ff1fa087123.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_f6621ad3ef1544e167d8b36850e5ce66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1d3f922fe828a159997088b1d1323d90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_657cc2836991fc5453575d37e09d5fbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b60cadf38411d9e66d56382a88dee792.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_8b06cd444dc7323f19ec58aac543cd84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_bd372c1887566d11748301a18152ac56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1b5f3737f414ae65c3bc00e8718d12ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_b150d802841de1acaa897b6eb1d7be82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_6bccd1caff2666d0a65f3513c7c2d8fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_3250a59153032b0bee75df25ad173dd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_954866c066509514bd5de3890500615f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_0999ec1c2721fb3aad7424f9bc3ec61c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165afd47-21c4-5f10-9959-6ec282e59818/165afd47-21c4-5f10-9959-6ec282e59818_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 76068,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img68/bb/68bb679f412c60c3b3db78dff6e48fb7/pa/ZC79503_1adc8bb7d271f21da5dc51c078d461dc.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2019}
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC79503%27 HTTP/1.1" 200 None
2025-12-05 17:06:40 [auto1.fr] INFO: Saving data for ZC79503: {'created_time': 1764954400.139222, 'last_price_update_time': 1764954400.139233, 'auction_closing_time': 1765038004.0}
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZC79503') HTTP/1.1" 204 0
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e375d0>
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_c1cced6ab8dc6ba09387ed1003726a30.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c1cced6ab8dc6ba09387ed1003726a30.jpg saved to cache
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58dc290>
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_aaef3afc10a0626795e95e38ebdf5499.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_aaef3afc10a0626795e95e38ebdf5499.jpg saved to cache
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN07206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG80116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59e6d50>
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F8b%252F038b21a045a18fbefa8f246a29d81066%252Fpa%252FSC31199_3c662b6535177825ac6da32ac138cfb7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_3c662b6535177825ac6da32ac138cfb7.jpg saved to cache
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6
2025-12-05 17:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6, skipping ID generation
2025-12-05 17:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 with scrape type 1
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 from tracking dictionaries
2025-12-05 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 sending to next pipeline
2025-12-05 17:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6, identifier: SC31199
2025-12-05 17:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 with identifier: VM80539
2025-12-05 17:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 with scrape type 2
2025-12-05 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 with scrape type 2
2025-12-05 17:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b4131667-bbf4-552e-9bbe-dfc2a11bfbe7, identifier: VM80539
2025-12-05 17:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0914c46c-6517-5861-a32c-393c2560c677 with identifier: VY92561
2025-12-05 17:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0914c46c-6517-5861-a32c-393c2560c677 with scrape type 2
2025-12-05 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0914c46c-6517-5861-a32c-393c2560c677 with scrape type 2
2025-12-05 17:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0914c46c-6517-5861-a32c-393c2560c677, identifier: VY92561
2025-12-05 17:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 with identifier: SC31199
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 with identifier: SC31199
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143602 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
143602
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 spider: auto1.fr
2025-12-05 17:06:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6 due to rule: high_mileage_for_make.json, error: 143602 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
143602
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:35:07Z',
'fuel_type': 'diesel',
'id': 'bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC31199',
'listing': 'auction',
'location': 'FR, Bourgoin Jallieu',
'make': 'Peugeot',
'model': '3008',
'odometer': 143602,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_3c662b6535177825ac6da32ac138cfb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c1cced6ab8dc6ba09387ed1003726a30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_f02163c65137a1323b3588885b16ed66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_c6245ba085e98c899a3d328ea72fbaa1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_aaef3afc10a0626795e95e38ebdf5499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7bcd307d8276436e0a4790697af4b394.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2565269,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7dff632a52b57cdc0e7d7f4596cd8a7e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7f036b576d6cbd163dcd79fc48eadd96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_6ad0a788a960c1725dec4c542719da45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_5eb0918ed1701797e170bf32e81a4a41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_8a116f0c3c73e6fcccf795c3834ed310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7da4cb79430c830eb8f679686121c0a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_b8af56aba07b12deeb3585a33d5a1d7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_eb6845ffb5e665522aee52264c82d084.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_4b4236b90d89b943bc72faf22f765784.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6/bee1b5c0-d6a0-555f-8efe-58b9ff9a5af6_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 79486,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img03/8b/038b21a045a18fbefa8f246a29d81066/pa/SC31199_7a7f8938f05b3e25100c9965c7204150.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC31199%27 HTTP/1.1" 200 None
2025-12-05 17:06:41 [auto1.fr] INFO: Saving data for SC31199: {'created_time': 1764954401.44663, 'last_price_update_time': 1764954401.446639, 'auction_closing_time': 1765038907.0}
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SC31199') HTTP/1.1" 204 0
2025-12-05 17:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 with identifier: VM80539
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 with identifier: VM80539
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 29269, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm80539', 'expiration_date': '2025-12-06t16:19:33z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b4131667-bbf4-552e-9bbe-dfc2a11bfbe7', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 29269}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:19:33z',
'fuel_type': 'petrol',
'id': 'b4131667-bbf4-552e-9bbe-dfc2a11bfbe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm80539',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 29269,
'odometer_in_km': 29269,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 spider: auto1.fr
2025-12-05 17:06:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b4131667-bbf4-552e-9bbe-dfc2a11bfbe7 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 29269, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm80539', 'expiration_date': '2025-12-06t16:19:33z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b4131667-bbf4-552e-9bbe-dfc2a11bfbe7', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 29269}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:19:33z',
'fuel_type': 'petrol',
'id': 'b4131667-bbf4-552e-9bbe-dfc2a11bfbe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vm80539',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 29269,
'odometer_in_km': 29269,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:19:33Z',
'fuel_type': 'petrol',
'id': 'b4131667-bbf4-552e-9bbe-dfc2a11bfbe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM80539',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 29269,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM80539%27 HTTP/1.1" 200 None
2025-12-05 17:06:41 [auto1.fr] INFO: Saving data for VM80539: {'auction_closing_time': 1765037973.0, 'created_time': 1764782089.317518, 'last_price_update_time': 1764954401.674837}
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VM80539') HTTP/1.1" 204 0
2025-12-05 17:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0914c46c-6517-5861-a32c-393c2560c677 with identifier: VY92561
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0914c46c-6517-5861-a32c-393c2560c677 with identifier: VY92561
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 34381, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vy92561', 'expiration_date': '2025-12-06t16:37:46z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '0914c46c-6517-5861-a32c-393c2560c677', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 34381}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:37:46z',
'fuel_type': 'petrol',
'id': '0914c46c-6517-5861-a32c-393c2560c677',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vy92561',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 34381,
'odometer_in_km': 34381,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0914c46c-6517-5861-a32c-393c2560c677 spider: auto1.fr
2025-12-05 17:06:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0914c46c-6517-5861-a32c-393c2560c677 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 34381, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vy92561', 'expiration_date': '2025-12-06t16:37:46z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '0914c46c-6517-5861-a32c-393c2560c677', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 34381}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:37:46z',
'fuel_type': 'petrol',
'id': '0914c46c-6517-5861-a32c-393c2560c677',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vy92561',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 34381,
'odometer_in_km': 34381,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:37:46Z',
'fuel_type': 'petrol',
'id': '0914c46c-6517-5861-a32c-393c2560c677',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY92561',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 34381,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-16',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY92561%27 HTTP/1.1" 200 None
2025-12-05 17:06:41 [auto1.fr] INFO: Saving data for VY92561: {'auction_closing_time': 1765039066.0, 'created_time': 1764782054.948807, 'last_price_update_time': 1764954401.91082}
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY92561') HTTP/1.1" 204 0
2025-12-05 17:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_016770401ecf8e77c681675c0861bca7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e72d0>
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_016770401ecf8e77c681675c0861bca7.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_016770401ecf8e77c681675c0861bca7.jpg saved to cache
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4def8d0>
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F13%252F291389defe58de9ff2a884b5047a7f54%252Fpa%252FMT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg saved to cache
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca
2025-12-05 17:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca, skipping ID generation
2025-12-05 17:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca with scrape type 1
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca from tracking dictionaries
2025-12-05 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca sending to next pipeline
2025-12-05 17:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca, identifier: MT12965
2025-12-05 17:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4deef90>
2025-12-05 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg saved to cache
2025-12-05 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a81cd0>
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd1%252F56d1cceebd2802f7b5148595583ef723%252Fpa%252FWN63847_f4236b64dc5722fedd4d9372115d5aed.jpg') HTTP/1.1" 204 0
2025-12-05 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg saved to cache
2025-12-05 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8eea424-6a92-5e56-9705-1e87a5504cd8
2025-12-05 17:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8eea424-6a92-5e56-9705-1e87a5504cd8, skipping ID generation
2025-12-05 17:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8eea424-6a92-5e56-9705-1e87a5504cd8 with scrape type 1
2025-12-05 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8eea424-6a92-5e56-9705-1e87a5504cd8 from tracking dictionaries
2025-12-05 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8eea424-6a92-5e56-9705-1e87a5504cd8 sending to next pipeline
2025-12-05 17:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8eea424-6a92-5e56-9705-1e87a5504cd8, identifier: WN63847
2025-12-05 17:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca with identifier: MT12965
2025-12-05 17:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca with identifier: MT12965
2025-12-05 17:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 63d86d1f-a7c7-55b5-b94f-fa66392ac6ca with identifier: MT12965 to the API
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 88,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:08:10Z',
'fuel_type': 'petrol',
'id': '63d86d1f-a7c7-55b5-b94f-fa66392ac6ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT12965',
'listing': 'auction',
'location': 'FR, Antibes',
'make': 'Fiat',
'model': '500C',
'odometer': 10122,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_62880a9d57bb4d73f2f102aa3fe560de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1ff788feb4a74d203f75df48adf7aa71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2246611,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_f16826d461e9dc9b70daa03b89742d29.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060951,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_16a1a6629289de547b68ed8bb798b2ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_3e8afb126fabf12c28e3e6ad643a3cdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_337c7c2eedf2b11343f532b459e0373b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_e6b336e7b8a7e83088dfbda24200221b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_1b28e7dcfb509900bafbdef009d6aee0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_357454b454715e93a16dcaef734b695c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2622556,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_15eb49fbaa98214faa655b03e8d69a5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2531594,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_016770401ecf8e77c681675c0861bca7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_076b5399f919ebe2afa1c8c1837fe3ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_fa95d76ae58910e4bdc0d48193252ed1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_8ee05494c86cf5fcced2df805923d5c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_314d9fbfa15dcae312203c166b028a64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63d86d1f-a7c7-55b5-b94f-fa66392ac6ca/63d86d1f-a7c7-55b5-b94f-fa66392ac6ca_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 82244,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img29/13/291389defe58de9ff2a884b5047a7f54/pa/MT12965_c35e90e0fdeec1732c4bed94c224a916.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-10',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2020}
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT12965%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Saving data for MT12965: {'created_time': 1764954404.028662, 'last_price_update_time': 1764954404.028672, 'auction_closing_time': 1765037290.0}
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT12965') HTTP/1.1" 204 0
2025-12-05 17:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8eea424-6a92-5e56-9705-1e87a5504cd8 with identifier: WN63847
2025-12-05 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8eea424-6a92-5e56-9705-1e87a5504cd8 with identifier: WN63847
2025-12-05 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 7511, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847', 'expiration_date': '2025-12-06t16:21:12z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, périgueux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 130584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3646718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 119233}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100541}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3801214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3714832}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 106100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3398595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 125549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3116981}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3322703}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52601}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3194108}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73310}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59978}], 'current_year_diff': 3, 'age_in_months': 44, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 7511}
Failed validating None in schema:
False
On instance:
{'age_in_months': 44,
'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:21:12z',
'fuel_type': 'petrol',
'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847',
'listing': 'auction',
'location': 'fr, périgueux',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 7511,
'odometer_in_km': 7511,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646718,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3801214,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3714832,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3398595,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3116981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3322703,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3194108,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-05',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech allure pack',
'transmission': 'automatic',
'trim': 'allure pack',
'year': 2022}
2025-12-05 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f8eea424-6a92-5e56-9705-1e87a5504cd8 spider: auto1.fr
2025-12-05 17:06:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f8eea424-6a92-5e56-9705-1e87a5504cd8 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 7511, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847', 'expiration_date': '2025-12-06t16:21:12z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, périgueux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 130584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3646718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 119233}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100541}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3801214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3714832}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 106100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3398595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 125549}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3116981}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3322703}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52601}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3194108}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73310}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59978}], 'current_year_diff': 3, 'age_in_months': 44, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 7511}
Failed validating None in schema:
False
On instance:
{'age_in_months': 44,
'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:21:12z',
'fuel_type': 'petrol',
'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847',
'listing': 'auction',
'location': 'fr, périgueux',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 7511,
'odometer_in_km': 7511,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646718,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3801214,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3714832,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3398595,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3116981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3322703,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3194108,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-05',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech allure pack',
'transmission': 'automatic',
'trim': 'allure pack',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:21:12Z',
'fuel_type': 'petrol',
'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN63847',
'listing': 'auction',
'location': 'FR, Périgueux',
'make': 'Peugeot',
'model': '308',
'odometer': 7511,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_32ec51377a8d3bccfcfadd7c63ee5e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646718,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_74897c58e671124cacb8255a15e3d619.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_062fe5f536f4d45eb2ac9f308708752a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1e5f0a5cba8e88ab1ad8be229c48b4a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3801214,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_f4236b64dc5722fedd4d9372115d5aed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3714832,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_a2d533458959c5b9aff5d7cb2efd58b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_fcf10af80a1859153c79a0fb32a1c4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3398595,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_2cd1e82a36c99cf648a7ed0dfd8fbf63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_d48dd4d41bd4c15ec53246ce71634bcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1b8c14e3b9c50a77a61a2faa74e1015c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3116981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_702de6588269e66ba0ab3e7499bb8803.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3322703,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_508705d45595dec7276cf56ee8a4b36f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ab797141b024a1d785487ba484286702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3194108,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_499f43c8c0a0587a799cad2612886689.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_1c1ceabfeb9bc43fe47829b66596987d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8eea424-6a92-5e56-9705-1e87a5504cd8/f8eea424-6a92-5e56-9705-1e87a5504cd8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/d1/56d1cceebd2802f7b5148595583ef723/pa/WN63847_ae03b8396a51412d2ce8a6e281892d84.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2022}
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN63847%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Saving data for WN63847: {'created_time': 1764954404.251631, 'last_price_update_time': 1764954404.25164, 'auction_closing_time': 1765038072.0}
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN63847') HTTP/1.1" 204 0
2025-12-05 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF20432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY74317> (referer: https://www.auto1.com/v1/car-details-view/DY74317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad1504a3-587a-5557-ba66-1ccba338cce5 with identifier: DY74317
2025-12-05 17:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad1504a3-587a-5557-ba66-1ccba338cce5 with scrape type 2
2025-12-05 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad1504a3-587a-5557-ba66-1ccba338cce5 with scrape type 2
2025-12-05 17:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad1504a3-587a-5557-ba66-1ccba338cce5, identifier: DY74317
2025-12-05 17:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad1504a3-587a-5557-ba66-1ccba338cce5 with identifier: DY74317
2025-12-05 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad1504a3-587a-5557-ba66-1ccba338cce5 with identifier: DY74317
2025-12-05 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 120820, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-09', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy74317', 'expiration_date': '2025-12-06t16:31:15z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'ad1504a3-587a-5557-ba66-1ccba338cce5', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 120820}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:31:15z',
'fuel_type': 'petrol',
'id': 'ad1504a3-587a-5557-ba66-1ccba338cce5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy74317',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 120820,
'odometer_in_km': 120820,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-09',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2017}
2025-12-05 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ad1504a3-587a-5557-ba66-1ccba338cce5 spider: auto1.fr
2025-12-05 17:06:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ad1504a3-587a-5557-ba66-1ccba338cce5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 120820, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-09', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy74317', 'expiration_date': '2025-12-06t16:31:15z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'ad1504a3-587a-5557-ba66-1ccba338cce5', 'current_year_diff': 8, 'age_in_months': 105, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 120820}
Failed validating None in schema:
False
On instance:
{'age_in_months': 105,
'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:31:15z',
'fuel_type': 'petrol',
'id': 'ad1504a3-587a-5557-ba66-1ccba338cce5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy74317',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 120820,
'odometer_in_km': 120820,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-09',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:31:15Z',
'fuel_type': 'petrol',
'id': 'ad1504a3-587a-5557-ba66-1ccba338cce5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY74317',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Citroen',
'model': 'C3',
'odometer': 120820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY74317%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Saving data for DY74317: {'auction_closing_time': 1765038675.0, 'created_time': 1764349555.04328, 'last_price_update_time': 1764954404.711209}
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DY74317') HTTP/1.1" 204 0
2025-12-05 17:06:44 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: KH23745
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH23745%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for KH23745: 0
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: ZT50667
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT50667%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for ZT50667: 0
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: EH77142
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH77142%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for EH77142: 1
2025-12-05 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: LF51092
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF51092%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for LF51092: 1
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: ZB75104
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB75104%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for ZB75104: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: TY21040
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY21040%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for TY21040: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: XP93068
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP93068%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for XP93068: 0
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: JM02151
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM02151%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for JM02151: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: CB06065
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB06065%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for CB06065: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: UG72158
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG72158%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for UG72158: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: EN65499
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN65499%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for EN65499: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: CR74460
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR74460%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for CR74460: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: UG60875
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG60875%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for UG60875: 1
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: ZX46142
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX46142%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for ZX46142: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: YP41249
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP41249%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for YP41249: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: DP72171
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP72171%27 HTTP/1.1" 200 None
2025-12-05 17:06:44 [auto1.fr] INFO: Scrape type for DP72171: 2
2025-12-05 17:06:44 [auto1.fr] INFO: Found listing with ID: EW10494
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW10494%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for EW10494: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: JU77399
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU77399%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for JU77399: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: ZG03481
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG03481%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for ZG03481: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: KM28318
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM28318%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for KM28318: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: DD95067
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD95067%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for DD95067: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: VG14184
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG14184%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for VG14184: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: XA35724
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA35724%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for XA35724: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: YK70717
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK70717%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for YK70717: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: WD79566
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD79566%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for WD79566: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: YL71607
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL71607%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for YL71607: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: UA76671
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA76671%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for UA76671: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: YG57630
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG57630%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for YG57630: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: GB12713
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB12713%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for GB12713: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: LT88767
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT88767%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for LT88767: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: UT27070
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT27070%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for UT27070: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: CU21590
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU21590%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for CU21590: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: JU35466
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU35466%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for JU35466: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: EF89576
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF89576%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for EF89576: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: DJ62641
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ62641%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for DJ62641: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: DE02662
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE02662%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for DE02662: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: PF13728
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF13728%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for PF13728: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: CH03574
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH03574%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for CH03574: 1
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: SV38255
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV38255%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for SV38255: 2
2025-12-05 17:06:45 [auto1.fr] INFO: Found listing with ID: SE39749
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE39749%27 HTTP/1.1" 200 None
2025-12-05 17:06:45 [auto1.fr] INFO: Scrape type for SE39749: 2
2025-12-05 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB97785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV13271/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH77142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG80116> (referer: https://www.auto1.com/v1/car-details-view/BG80116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75bb1d5c-cd94-55e0-8711-5980dac98b71 with identifier: BG80116
2025-12-05 17:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75bb1d5c-cd94-55e0-8711-5980dac98b71 with scrape type 2
2025-12-05 17:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75bb1d5c-cd94-55e0-8711-5980dac98b71 with scrape type 2
2025-12-05 17:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75bb1d5c-cd94-55e0-8711-5980dac98b71, identifier: BG80116
2025-12-05 17:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75bb1d5c-cd94-55e0-8711-5980dac98b71 with identifier: BG80116
2025-12-05 17:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75bb1d5c-cd94-55e0-8711-5980dac98b71 with identifier: BG80116
2025-12-05 17:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 75bb1d5c-cd94-55e0-8711-5980dac98b71 with identifier: BG80116 to the API
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BG80116>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:47:03Z',
'fuel_type': 'gas',
'id': '75bb1d5c-cd94-55e0-8711-5980dac98b71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG80116',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 28931,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG80116%27 HTTP/1.1" 200 None
2025-12-05 17:06:58 [auto1.fr] INFO: Saving data for BG80116: {'auction_closing_time': 1765039623.0, 'created_time': 1764609279.185295, 'last_price_update_time': 1764954418.882217}
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BG80116') HTTP/1.1" 204 0
2025-12-05 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX95434> (referer: https://www.auto1.com/v1/car-details-view/CX95434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 with identifier: CX95434
2025-12-05 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 with scrape type 1
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_63921e85404e97b8a6b87aa8e28580a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_63921e85404e97b8a6b87aa8e28580a6.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_440bea6ebb3147a3b04aeb98dafb18a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_440bea6ebb3147a3b04aeb98dafb18a5.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_259d0ae86393d8a0431ce875ed6eb104.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_259d0ae86393d8a0431ce875ed6eb104.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_849324ce7fd0fecf6a7fa209e2162d15.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_849324ce7fd0fecf6a7fa209e2162d15.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_82e9d219eeb8d7cb9649baf1f6f62a19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82e9d219eeb8d7cb9649baf1f6f62a19.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_75cf8c525c40016780e8ce14d8b268f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_75cf8c525c40016780e8ce14d8b268f6.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_39052b6b10b917f19bba5b216b8b18be.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_39052b6b10b917f19bba5b216b8b18be.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_6c12ac9368b7cc8423b8c97a2353969d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6c12ac9368b7cc8423b8c97a2353969d.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_2402610eb68c83c668639f224ab45e39.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2402610eb68c83c668639f224ab45e39.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_edbdd0e9c7142a1eeaa59163918d06da.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edbdd0e9c7142a1eeaa59163918d06da.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_b6d39a0362c51339e0b46b217afaa544.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_b6d39a0362c51339e0b46b217afaa544.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_82c8917290f2026b1d7403309616438e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82c8917290f2026b1d7403309616438e.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_bdf8f29a3a3d61b9dade9984a9092a5d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_bdf8f29a3a3d61b9dade9984a9092a5d.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_6aab0f6f5cbf2c1737f8cfff73bcb0df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6aab0f6f5cbf2c1737f8cfff73bcb0df.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_957d59648d48eaa35fe6c2e851419fb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_957d59648d48eaa35fe6c2e851419fb0.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_98293c93aab256d1089d1e4ca188a995.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_98293c93aab256d1089d1e4ca188a995.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_2be2ce96edd98300ce9fceafb0925911.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2be2ce96edd98300ce9fceafb0925911.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_159d5ce6709f597bb8178de734cf5f5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_159d5ce6709f597bb8178de734cf5f5b.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_356ee36d7e0370d4e808ae86fe188cb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_356ee36d7e0370d4e808ae86fe188cb2.jpg not downloaded yet
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_edf531089701e938c3a7d08dcd437906.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edf531089701e938c3a7d08dcd437906.jpg not downloaded yet
2025-12-05 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB75104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edf531089701e938c3a7d08dcd437906.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c602d0>
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_edf531089701e938c3a7d08dcd437906.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edf531089701e938c3a7d08dcd437906.jpg saved to cache
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM02151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_356ee36d7e0370d4e808ae86fe188cb2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_159d5ce6709f597bb8178de734cf5f5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575f950>
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_356ee36d7e0370d4e808ae86fe188cb2.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_356ee36d7e0370d4e808ae86fe188cb2.jpg saved to cache
2025-12-05 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2be2ce96edd98300ce9fceafb0925911.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a227d0>
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_159d5ce6709f597bb8178de734cf5f5b.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_159d5ce6709f597bb8178de734cf5f5b.jpg saved to cache
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5824610>
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_2be2ce96edd98300ce9fceafb0925911.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2be2ce96edd98300ce9fceafb0925911.jpg saved to cache
2025-12-05 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG72158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_98293c93aab256d1089d1e4ca188a995.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d21390>
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_98293c93aab256d1089d1e4ca188a995.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_98293c93aab256d1089d1e4ca188a995.jpg saved to cache
2025-12-05 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:07 [scrapy.extensions.logstats] INFO: Crawled 635 pages (at 27 pages/min), scraped 150 items (at 9 items/min)
2025-12-05 17:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN07206> (referer: https://www.auto1.com/v1/car-details-view/XN07206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351de964-b41b-5d26-a0de-aae3e006ccea with identifier: XN07206
2025-12-05 17:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351de964-b41b-5d26-a0de-aae3e006ccea with scrape type 2
2025-12-05 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 351de964-b41b-5d26-a0de-aae3e006ccea with scrape type 2
2025-12-05 17:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 351de964-b41b-5d26-a0de-aae3e006ccea, identifier: XN07206
2025-12-05 17:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 351de964-b41b-5d26-a0de-aae3e006ccea with identifier: XN07206
2025-12-05 17:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 351de964-b41b-5d26-a0de-aae3e006ccea with identifier: XN07206
2025-12-05 17:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 27418, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xn07206', 'expiration_date': '2025-12-06t16:59:22z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '351de964-b41b-5d26-a0de-aae3e006ccea', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 27418}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:59:22z',
'fuel_type': 'petrol',
'id': '351de964-b41b-5d26-a0de-aae3e006ccea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xn07206',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 27418,
'odometer_in_km': 27418,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
2025-12-05 17:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 351de964-b41b-5d26-a0de-aae3e006ccea spider: auto1.fr
2025-12-05 17:07:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 351de964-b41b-5d26-a0de-aae3e006ccea due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 27418, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xn07206', 'expiration_date': '2025-12-06t16:59:22z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '351de964-b41b-5d26-a0de-aae3e006ccea', 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 27418}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:59:22z',
'fuel_type': 'petrol',
'id': '351de964-b41b-5d26-a0de-aae3e006ccea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xn07206',
'listing': 'auction',
'location': 'fr',
'make': 'opel',
'make_model': 'opel crossland x',
'model': 'crossland x',
'odometer': 27418,
'odometer_in_km': 27418,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland x 1.2 turbo business elegance',
'transmission': 'manual',
'trim': 'business elegance',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:59:22Z',
'fuel_type': 'petrol',
'id': '351de964-b41b-5d26-a0de-aae3e006ccea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN07206',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 27418,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2023}
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN07206%27 HTTP/1.1" 200 None
2025-12-05 17:07:20 [auto1.fr] INFO: Saving data for XN07206: {'auction_closing_time': 1765040362.0, 'created_time': 1764782119.258265, 'last_price_update_time': 1764954440.527854}
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XN07206') HTTP/1.1" 204 0
2025-12-05 17:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_957d59648d48eaa35fe6c2e851419fb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6aab0f6f5cbf2c1737f8cfff73bcb0df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef58d0>
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_957d59648d48eaa35fe6c2e851419fb0.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_957d59648d48eaa35fe6c2e851419fb0.jpg saved to cache
2025-12-05 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_bdf8f29a3a3d61b9dade9984a9092a5d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5824350>
2025-12-05 17:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_6aab0f6f5cbf2c1737f8cfff73bcb0df.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6aab0f6f5cbf2c1737f8cfff73bcb0df.jpg saved to cache
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef6390>
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_bdf8f29a3a3d61b9dade9984a9092a5d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_bdf8f29a3a3d61b9dade9984a9092a5d.jpg saved to cache
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82c8917290f2026b1d7403309616438e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_b6d39a0362c51339e0b46b217afaa544.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c6a990>
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_82c8917290f2026b1d7403309616438e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82c8917290f2026b1d7403309616438e.jpg saved to cache
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edbdd0e9c7142a1eeaa59163918d06da.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c63a10>
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_b6d39a0362c51339e0b46b217afaa544.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_b6d39a0362c51339e0b46b217afaa544.jpg saved to cache
2025-12-05 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2402610eb68c83c668639f224ab45e39.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE39749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a90590>
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_edbdd0e9c7142a1eeaa59163918d06da.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edbdd0e9c7142a1eeaa59163918d06da.jpg saved to cache
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6c12ac9368b7cc8423b8c97a2353969d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57d6950>
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_2402610eb68c83c668639f224ab45e39.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2402610eb68c83c668639f224ab45e39.jpg saved to cache
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_39052b6b10b917f19bba5b216b8b18be.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef6710>
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_6c12ac9368b7cc8423b8c97a2353969d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6c12ac9368b7cc8423b8c97a2353969d.jpg saved to cache
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_75cf8c525c40016780e8ce14d8b268f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da9ad0>
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_39052b6b10b917f19bba5b216b8b18be.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_39052b6b10b917f19bba5b216b8b18be.jpg saved to cache
2025-12-05 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82e9d219eeb8d7cb9649baf1f6f62a19.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c63510>
2025-12-05 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_75cf8c525c40016780e8ce14d8b268f6.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_75cf8c525c40016780e8ce14d8b268f6.jpg saved to cache
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_849324ce7fd0fecf6a7fa209e2162d15.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5741e50>
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_82e9d219eeb8d7cb9649baf1f6f62a19.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82e9d219eeb8d7cb9649baf1f6f62a19.jpg saved to cache
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_259d0ae86393d8a0431ce875ed6eb104.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5741e50>
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_849324ce7fd0fecf6a7fa209e2162d15.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_849324ce7fd0fecf6a7fa209e2162d15.jpg saved to cache
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV38255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c61150>
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_259d0ae86393d8a0431ce875ed6eb104.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_259d0ae86393d8a0431ce875ed6eb104.jpg saved to cache
2025-12-05 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_440bea6ebb3147a3b04aeb98dafb18a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_63921e85404e97b8a6b87aa8e28580a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb5590>
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_440bea6ebb3147a3b04aeb98dafb18a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_440bea6ebb3147a3b04aeb98dafb18a5.jpg saved to cache
2025-12-05 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9f7d0>
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F7f%252Fde7f03ecf1e995e472ba93d4cb19b2ba%252Fpa%252FCX95434_63921e85404e97b8a6b87aa8e28580a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_63921e85404e97b8a6b87aa8e28580a6.jpg saved to cache
2025-12-05 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1
2025-12-05 17:07:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1, skipping ID generation
2025-12-05 17:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 with scrape type 1
2025-12-05 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 from tracking dictionaries
2025-12-05 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 sending to next pipeline
2025-12-05 17:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1, identifier: CX95434
2025-12-05 17:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 with identifier: CX95434
2025-12-05 17:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 with identifier: CX95434
2025-12-05 17:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 105675 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
105675
2025-12-05 17:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 spider: auto1.fr
2025-12-05 17:07:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1 due to rule: high_mileage_for_make.json, error: 105675 is greater than the maximum of 100000
Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
{'maximum': 100000, 'type': 'integer'}
On instance['odometer_in_km']:
105675
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 299,
'expiration_date': '2025-12-06T16:08:41Z',
'fuel_type': 'electro',
'id': 'bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX95434',
'listing': 'auction',
'location': 'FR',
'make': 'Tesla',
'model': 'Model Y',
'odometer': 105675,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_63921e85404e97b8a6b87aa8e28580a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_440bea6ebb3147a3b04aeb98dafb18a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_259d0ae86393d8a0431ce875ed6eb104.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_849324ce7fd0fecf6a7fa209e2162d15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82e9d219eeb8d7cb9649baf1f6f62a19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_75cf8c525c40016780e8ce14d8b268f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_39052b6b10b917f19bba5b216b8b18be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6c12ac9368b7cc8423b8c97a2353969d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2402610eb68c83c668639f224ab45e39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edbdd0e9c7142a1eeaa59163918d06da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_b6d39a0362c51339e0b46b217afaa544.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_82c8917290f2026b1d7403309616438e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_bdf8f29a3a3d61b9dade9984a9092a5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_6aab0f6f5cbf2c1737f8cfff73bcb0df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_957d59648d48eaa35fe6c2e851419fb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_98293c93aab256d1089d1e4ca188a995.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_2be2ce96edd98300ce9fceafb0925911.jpg',
'Width': 277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_159d5ce6709f597bb8178de734cf5f5b.jpg',
'Width': 277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_356ee36d7e0370d4e808ae86fe188cb2.jpg',
'Width': 277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1/bbbd3d1e-d4a5-5e00-b9a4-f2167320e7e1_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/7f/de7f03ecf1e995e472ba93d4cb19b2ba/pa/CX95434_edf531089701e938c3a7d08dcd437906.jpg',
'Width': 277}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla Model Y Standard Range',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX95434%27 HTTP/1.1" 200 None
2025-12-05 17:07:24 [auto1.fr] INFO: Saving data for CX95434: {'created_time': 1764954444.908306, 'last_price_update_time': 1764954444.908316, 'auction_closing_time': 1765037321.0}
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX95434') HTTP/1.1" 204 0
2025-12-05 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV13271> (referer: https://www.auto1.com/v1/car-details-view/LV13271/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cf25d7-3d1d-54b3-b1a6-7988e281a656 with identifier: LV13271
2025-12-05 17:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cf25d7-3d1d-54b3-b1a6-7988e281a656 with scrape type 2
2025-12-05 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cf25d7-3d1d-54b3-b1a6-7988e281a656 with scrape type 2
2025-12-05 17:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94cf25d7-3d1d-54b3-b1a6-7988e281a656, identifier: LV13271
2025-12-05 17:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94cf25d7-3d1d-54b3-b1a6-7988e281a656 with identifier: LV13271
2025-12-05 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94cf25d7-3d1d-54b3-b1a6-7988e281a656 with identifier: LV13271
2025-12-05 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 139025, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv13271', 'expiration_date': '2025-12-06t16:11:48z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '94cf25d7-3d1d-54b3-b1a6-7988e281a656', 'current_year_diff': 5, 'age_in_months': 64, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 139025}
Failed validating None in schema:
False
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:11:48z',
'fuel_type': 'petrol',
'id': '94cf25d7-3d1d-54b3-b1a6-7988e281a656',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv13271',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 139025,
'odometer_in_km': 139025,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2020}
2025-12-05 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 94cf25d7-3d1d-54b3-b1a6-7988e281a656 spider: auto1.fr
2025-12-05 17:07:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 94cf25d7-3d1d-54b3-b1a6-7988e281a656 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 139025, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv13271', 'expiration_date': '2025-12-06t16:11:48z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '94cf25d7-3d1d-54b3-b1a6-7988e281a656', 'current_year_diff': 5, 'age_in_months': 64, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 139025}
Failed validating None in schema:
False
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:11:48z',
'fuel_type': 'petrol',
'id': '94cf25d7-3d1d-54b3-b1a6-7988e281a656',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv13271',
'listing': 'auction',
'location': 'fr, tarnos',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 139025,
'odometer_in_km': 139025,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:11:48Z',
'fuel_type': 'petrol',
'id': '94cf25d7-3d1d-54b3-b1a6-7988e281a656',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV13271',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Citroen',
'model': 'C3',
'odometer': 139025,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2020}
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV13271%27 HTTP/1.1" 200 None
2025-12-05 17:07:30 [auto1.fr] INFO: Saving data for LV13271: {'auction_closing_time': 1765037508.0, 'created_time': 1762840940.459723, 'last_price_update_time': 1764954450.382524}
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LV13271') HTTP/1.1" 204 0
2025-12-05 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY21040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB97785> (referer: https://www.auto1.com/v1/car-details-view/AB97785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 with identifier: AB97785
2025-12-05 17:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 with scrape type 1
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_a9416ef98d8c08f22631028403dff2c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_a9416ef98d8c08f22631028403dff2c0.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_2865d40afad3ebdc6ce6b319db73842b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_2865d40afad3ebdc6ce6b319db73842b.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_651b1530dae3af8e37672c35d0d7d48c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_651b1530dae3af8e37672c35d0d7d48c.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_858fd9b58e776a528c47732bceacecb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_858fd9b58e776a528c47732bceacecb3.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_d299b34b99561e89daaaa191961ac2bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_d299b34b99561e89daaaa191961ac2bd.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_87d5dbf700b82afb282fb7bdde45a8f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_87d5dbf700b82afb282fb7bdde45a8f6.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_652569751c8e8c3a668b185355d1f920.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_652569751c8e8c3a668b185355d1f920.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_ea600699e2617b5c6128ba495436a688.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_ea600699e2617b5c6128ba495436a688.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_7b825c4de6db73d9cd9fe6d372bc9662.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_7b825c4de6db73d9cd9fe6d372bc9662.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_9b59ff7c7a241c3b9c20de4ae98314b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_9b59ff7c7a241c3b9c20de4ae98314b1.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_c6a85bdebfa99ad9f351daef274fbc36.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c6a85bdebfa99ad9f351daef274fbc36.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_3543718295c6d4717a1e37d2f205d14b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_3543718295c6d4717a1e37d2f205d14b.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_777d05bc4abc30d8c679f3d86b50e752.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_777d05bc4abc30d8c679f3d86b50e752.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_8180f21b43405c2075463d16b4be38ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_8180f21b43405c2075463d16b4be38ee.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_c8342868964933e4dfb683aa3242ee5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c8342868964933e4dfb683aa3242ee5a.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_1bc958750910334cb8c838948f20000c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_1bc958750910334cb8c838948f20000c.jpg not downloaded yet
2025-12-05 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH77142> (referer: https://www.auto1.com/v1/car-details-view/EH77142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_1bc958750910334cb8c838948f20000c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f84848c-7ddf-5580-8dbe-7512de677b17 with identifier: EH77142
2025-12-05 17:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f84848c-7ddf-5580-8dbe-7512de677b17 with scrape type 1
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_33206fac32df7902c71f6c1136f2301d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_95475700582782a48ff5effe604edafc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_89571bd6cfdc915812466e8b1227f38d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg not downloaded yet
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_5f72229d2973082aa9f7305a6ac41006.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg not downloaded yet
2025-12-05 17:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c69490>
2025-12-05 17:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_1bc958750910334cb8c838948f20000c.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_1bc958750910334cb8c838948f20000c.jpg saved to cache
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg not downloaded yet
2025-12-05 17:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c8342868964933e4dfb683aa3242ee5a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_163631fcb9ade3f2770b0ba561e9d533.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_3c6146e604c4f9223cb4851a47772c91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_05e4c5142226547426ecaf7a64b416f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_34c09e7f19731f91975f370d79eff01e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_4ba138122223c2e02dab9148337809f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_23a25ff41435bfbdbd5896bf46140b06.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg not downloaded yet
2025-12-05 17:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB75104> (referer: https://www.auto1.com/v1/car-details-view/ZB75104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5826fd0>
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_c8342868964933e4dfb683aa3242ee5a.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c8342868964933e4dfb683aa3242ee5a.jpg saved to cache
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg not downloaded yet
2025-12-05 17:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_006756191eff6032ad3174c500bb4abb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg not downloaded yet
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_15c3be2063011e458c1ff00cc78a79f1.png%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png not downloaded yet
2025-12-05 17:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac with identifier: ZB75104
2025-12-05 17:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac with scrape type 2
2025-12-05 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac with scrape type 2
2025-12-05 17:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac, identifier: ZB75104
2025-12-05 17:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac with identifier: ZB75104
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac with identifier: ZB75104
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143214 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
143214
2025-12-05 17:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac spider: auto1.fr
2025-12-05 17:07:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5de88b19-dd1e-52d3-9d7b-3489e3c3dbac due to rule: high_mileage_for_make.json, error: 143214 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
143214
{'auction_title': '',
'c_o_2_emission_value': 52,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 225,
'expiration_date': '2025-12-06T16:41:17Z',
'fuel_type': 'hybrid',
'id': '5de88b19-dd1e-52d3-9d7b-3489e3c3dbac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB75104',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'MINI',
'model': 'Countryman',
'odometer': 143214,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S E Hybrid ALL4 Chili',
'transmission': 'automatic',
'trim': 'ALL4 Chili',
'year': 2018}
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB75104%27 HTTP/1.1" 200 None
2025-12-05 17:07:33 [auto1.fr] INFO: Saving data for ZB75104: {'auction_closing_time': 1765039277.0, 'created_time': 1764003623.924898, 'last_price_update_time': 1764954453.942836}
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB75104') HTTP/1.1" 204 0
2025-12-05 17:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png> (referer: https://www.auto1.com/)
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c9390>
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_23a25ff41435bfbdbd5896bf46140b06.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg saved to cache
2025-12-05 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7b0d0>
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg saved to cache
2025-12-05 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5877b50>
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_006756191eff6032ad3174c500bb4abb.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg saved to cache
2025-12-05 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:34 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:07:34 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:07:34 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:07:34 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7bbd0>
2025-12-05 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_15.png HTTP/1.1" 201 0
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_15c3be2063011e458c1ff00cc78a79f1.png') HTTP/1.1" 204 0
2025-12-05 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png saved to cache
2025-12-05 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582f110>
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_4ba138122223c2e02dab9148337809f8.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg saved to cache
2025-12-05 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579de10>
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg saved to cache
2025-12-05 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c6780f50>
2025-12-05 17:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_34c09e7f19731f91975f370d79eff01e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg saved to cache
2025-12-05 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG72158> (referer: https://www.auto1.com/v1/car-details-view/UG72158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3514ebf5-673d-5d4a-b229-285e95ae0a79 with identifier: UG72158
2025-12-05 17:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3514ebf5-673d-5d4a-b229-285e95ae0a79 with scrape type 2
2025-12-05 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3514ebf5-673d-5d4a-b229-285e95ae0a79 with scrape type 2
2025-12-05 17:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3514ebf5-673d-5d4a-b229-285e95ae0a79, identifier: UG72158
2025-12-05 17:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3514ebf5-673d-5d4a-b229-285e95ae0a79 with identifier: UG72158
2025-12-05 17:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3514ebf5-673d-5d4a-b229-285e95ae0a79 with identifier: UG72158
2025-12-05 17:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3514ebf5-673d-5d4a-b229-285e95ae0a79 with identifier: UG72158 to the API
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG72158>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2025-12-06T16:54:54Z',
'fuel_type': 'petrol',
'id': '3514ebf5-673d-5d4a-b229-285e95ae0a79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG72158',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Clio',
'odometer': 47099,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-17',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2021}
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG72158%27 HTTP/1.1" 200 None
2025-12-05 17:07:36 [auto1.fr] INFO: Saving data for UG72158: {'auction_closing_time': 1765040094.0, 'created_time': 1764669852.299933, 'last_price_update_time': 1764954456.815066}
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG72158') HTTP/1.1" 204 0
2025-12-05 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57888d0>
2025-12-05 17:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_3c6146e604c4f9223cb4851a47772c91.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg saved to cache
2025-12-05 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583ec50>
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_163631fcb9ade3f2770b0ba561e9d533.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg saved to cache
2025-12-05 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5743a10>
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg saved to cache
2025-12-05 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a95790>
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_05e4c5142226547426ecaf7a64b416f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg saved to cache
2025-12-05 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE39749> (referer: https://www.auto1.com/v1/car-details-view/SE39749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ded750>
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_5f72229d2973082aa9f7305a6ac41006.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg saved to cache
2025-12-05 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 with identifier: SE39749
2025-12-05 17:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 with scrape type 2
2025-12-05 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 with scrape type 2
2025-12-05 17:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0542cbb-7f86-58f7-bc46-36a57b2bb9a6, identifier: SE39749
2025-12-05 17:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 with identifier: SE39749
2025-12-05 17:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 with identifier: SE39749
2025-12-05 17:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147602 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
147602
2025-12-05 17:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 spider: auto1.fr
2025-12-05 17:07:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d0542cbb-7f86-58f7-bc46-36a57b2bb9a6 due to rule: high_mileage_for_make.json, error: 147602 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
147602
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:51:44Z',
'fuel_type': 'diesel',
'id': 'd0542cbb-7f86-58f7-bc46-36a57b2bb9a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE39749',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '3008',
'odometer': 147602,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2019}
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE39749%27 HTTP/1.1" 200 None
2025-12-05 17:07:39 [auto1.fr] INFO: Saving data for SE39749: {'auction_closing_time': 1765039904.0, 'created_time': 1762840848.10659, 'last_price_update_time': 1764954459.013096}
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE39749') HTTP/1.1" 204 0
2025-12-05 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5880150>
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg saved to cache
2025-12-05 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_8180f21b43405c2075463d16b4be38ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c7250>
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_89571bd6cfdc915812466e8b1227f38d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg saved to cache
2025-12-05 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a90290>
2025-12-05 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_95475700582782a48ff5effe604edafc.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg saved to cache
2025-12-05 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5875d10>
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F51%252F6d51fcafeb715352b99ebf63d96847c5%252Fpa%252FEH77142_33206fac32df7902c71f6c1136f2301d.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg saved to cache
2025-12-05 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f84848c-7ddf-5580-8dbe-7512de677b17
2025-12-05 17:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f84848c-7ddf-5580-8dbe-7512de677b17, skipping ID generation
2025-12-05 17:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f84848c-7ddf-5580-8dbe-7512de677b17 with scrape type 1
2025-12-05 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3f84848c-7ddf-5580-8dbe-7512de677b17 from tracking dictionaries
2025-12-05 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f84848c-7ddf-5580-8dbe-7512de677b17 sending to next pipeline
2025-12-05 17:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3f84848c-7ddf-5580-8dbe-7512de677b17, identifier: EH77142
2025-12-05 17:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3f84848c-7ddf-5580-8dbe-7512de677b17 with identifier: EH77142
2025-12-05 17:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3f84848c-7ddf-5580-8dbe-7512de677b17 with identifier: EH77142
2025-12-05 17:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel astra 1.2 turbo gs', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'astra', 'transmission': 'automatic', 'odometer': 27445, 'odometer_reading_unit': 'km', 'registration_date': '2023-03-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eh77142', 'expiration_date': '2025-12-06t16:14:17z', 'origin_country_code': 'fr', 'trim': 'gs', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, puget-sur-argens', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '3f84848c-7ddf-5580-8dbe-7512de677b17', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2762839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3010970}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3141027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53994}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3080008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3087594}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56283}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2819665}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3083659}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3176903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2885378}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59116}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2880938}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87207}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 77677}], 'current_year_diff': 2, 'age_in_months': 32, 'make_model': 'opel astra', 'sanitized_make': 'opel', 'odometer_in_km': 27445}
Failed validating None in schema:
False
On instance:
{'age_in_months': 32,
'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:14:17z',
'fuel_type': 'petrol',
'id': '3f84848c-7ddf-5580-8dbe-7512de677b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eh77142',
'listing': 'auction',
'location': 'fr, puget-sur-argens',
'make': 'opel',
'make_model': 'opel astra',
'model': 'astra',
'odometer': 27445,
'odometer_in_km': 27445,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2762839,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3010970,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3141027,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3080008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087594,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819665,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3083659,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3176903,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2885378,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2880938,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77677,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel astra 1.2 turbo gs',
'transmission': 'automatic',
'trim': 'gs',
'year': 2023}
2025-12-05 17:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 3f84848c-7ddf-5580-8dbe-7512de677b17 spider: auto1.fr
2025-12-05 17:07:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3f84848c-7ddf-5580-8dbe-7512de677b17 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel astra 1.2 turbo gs', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'astra', 'transmission': 'automatic', 'odometer': 27445, 'odometer_reading_unit': 'km', 'registration_date': '2023-03-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eh77142', 'expiration_date': '2025-12-06t16:14:17z', 'origin_country_code': 'fr', 'trim': 'gs', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, puget-sur-argens', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '3f84848c-7ddf-5580-8dbe-7512de677b17', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2762839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3010970}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3141027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53994}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3080008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3087594}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56283}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2819665}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3083659}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3176903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2885378}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59116}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2880938}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 87207}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 77677}], 'current_year_diff': 2, 'age_in_months': 32, 'make_model': 'opel astra', 'sanitized_make': 'opel', 'odometer_in_km': 27445}
Failed validating None in schema:
False
On instance:
{'age_in_months': 32,
'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:14:17z',
'fuel_type': 'petrol',
'id': '3f84848c-7ddf-5580-8dbe-7512de677b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eh77142',
'listing': 'auction',
'location': 'fr, puget-sur-argens',
'make': 'opel',
'make_model': 'opel astra',
'model': 'astra',
'odometer': 27445,
'odometer_in_km': 27445,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2762839,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3010970,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3141027,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3080008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087594,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819665,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3083659,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3176903,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2885378,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2880938,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77677,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel astra 1.2 turbo gs',
'transmission': 'automatic',
'trim': 'gs',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:14:17Z',
'fuel_type': 'petrol',
'id': '3f84848c-7ddf-5580-8dbe-7512de677b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH77142',
'listing': 'auction',
'location': 'FR, Puget-sur-Argens',
'make': 'Opel',
'model': 'Astra',
'odometer': 27445,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2762839,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_33206fac32df7902c71f6c1136f2301d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3010970,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_95475700582782a48ff5effe604edafc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3141027,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_89571bd6cfdc915812466e8b1227f38d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_5f72229d2973082aa9f7305a6ac41006.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3080008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_43573c94e299a74b0d78b11d3bf6b8db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087594,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_7d348b189852bd7f2358dc0dbb0cd73f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_91db2e19f29c4a8353dbcfc7a0709fa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819665,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_163631fcb9ade3f2770b0ba561e9d533.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3083659,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_3c6146e604c4f9223cb4851a47772c91.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3176903,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_05e4c5142226547426ecaf7a64b416f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2885378,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_34c09e7f19731f91975f370d79eff01e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_4ba138122223c2e02dab9148337809f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_23a25ff41435bfbdbd5896bf46140b06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2880938,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_13067e3b1d0e30c50456b118eaaddcdd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_006756191eff6032ad3174c500bb4abb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f84848c-7ddf-5580-8dbe-7512de677b17/3f84848c-7ddf-5580-8dbe-7512de677b17_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77677,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img6d/51/6d51fcafeb715352b99ebf63d96847c5/pa/EH77142_15c3be2063011e458c1ff00cc78a79f1.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo GS',
'transmission': 'automatic',
'trim': 'GS',
'year': 2023}
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH77142%27 HTTP/1.1" 200 None
2025-12-05 17:07:40 [auto1.fr] INFO: Saving data for EH77142: {'created_time': 1764954460.995299, 'last_price_update_time': 1764954460.995309, 'auction_closing_time': 1765037657.0}
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH77142') HTTP/1.1" 204 0
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5781e50>
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_8180f21b43405c2075463d16b4be38ee.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_8180f21b43405c2075463d16b4be38ee.jpg saved to cache
2025-12-05 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_3543718295c6d4717a1e37d2f205d14b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c6a85bdebfa99ad9f351daef274fbc36.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a92fd0>
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_3543718295c6d4717a1e37d2f205d14b.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_3543718295c6d4717a1e37d2f205d14b.jpg saved to cache
2025-12-05 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_9b59ff7c7a241c3b9c20de4ae98314b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_777d05bc4abc30d8c679f3d86b50e752.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d239d0>
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_c6a85bdebfa99ad9f351daef274fbc36.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c6a85bdebfa99ad9f351daef274fbc36.jpg saved to cache
2025-12-05 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_7b825c4de6db73d9cd9fe6d372bc9662.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_ea600699e2617b5c6128ba495436a688.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5813e10>
2025-12-05 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_9b59ff7c7a241c3b9c20de4ae98314b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_9b59ff7c7a241c3b9c20de4ae98314b1.jpg saved to cache
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e1c10>
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_777d05bc4abc30d8c679f3d86b50e752.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_777d05bc4abc30d8c679f3d86b50e752.jpg saved to cache
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_652569751c8e8c3a668b185355d1f920.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_858fd9b58e776a528c47732bceacecb3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_d299b34b99561e89daaaa191961ac2bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_87d5dbf700b82afb282fb7bdde45a8f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a23450>
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_7b825c4de6db73d9cd9fe6d372bc9662.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_7b825c4de6db73d9cd9fe6d372bc9662.jpg saved to cache
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da1f50>
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_ea600699e2617b5c6128ba495436a688.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_ea600699e2617b5c6128ba495436a688.jpg saved to cache
2025-12-05 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_2865d40afad3ebdc6ce6b319db73842b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_651b1530dae3af8e37672c35d0d7d48c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f6dd0>
2025-12-05 17:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_652569751c8e8c3a668b185355d1f920.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_652569751c8e8c3a668b185355d1f920.jpg saved to cache
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a73250>
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_858fd9b58e776a528c47732bceacecb3.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_858fd9b58e776a528c47732bceacecb3.jpg saved to cache
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a738d0>
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_d299b34b99561e89daaaa191961ac2bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_d299b34b99561e89daaaa191961ac2bd.jpg saved to cache
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a719d0>
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_87d5dbf700b82afb282fb7bdde45a8f6.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_87d5dbf700b82afb282fb7bdde45a8f6.jpg saved to cache
2025-12-05 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_a9416ef98d8c08f22631028403dff2c0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58462d0>
2025-12-05 17:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_2865d40afad3ebdc6ce6b319db73842b.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_2865d40afad3ebdc6ce6b319db73842b.jpg saved to cache
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5891510>
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_651b1530dae3af8e37672c35d0d7d48c.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_651b1530dae3af8e37672c35d0d7d48c.jpg saved to cache
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cc710>
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F84%252Fc0848bab0058795ad3855ffc1639f734%252Fpa%252FAB97785_a9416ef98d8c08f22631028403dff2c0.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_a9416ef98d8c08f22631028403dff2c0.jpg saved to cache
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22
2025-12-05 17:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22, skipping ID generation
2025-12-05 17:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 with scrape type 1
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 from tracking dictionaries
2025-12-05 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 sending to next pipeline
2025-12-05 17:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22, identifier: AB97785
2025-12-05 17:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 with identifier: AB97785
2025-12-05 17:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 with identifier: AB97785
2025-12-05 17:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9bfe8ee4-c23e-552c-95a7-4d1036ca3c22 with identifier: AB97785 to the API
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_a9416ef98d8c08f22631028403dff2c0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:52:56Z',
'fuel_type': 'petrol',
'id': '9bfe8ee4-c23e-552c-95a7-4d1036ca3c22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB97785',
'listing': 'auction',
'location': 'FR, Nice',
'make': 'Seat',
'model': 'Ateca',
'odometer': 147520,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_a9416ef98d8c08f22631028403dff2c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_2865d40afad3ebdc6ce6b319db73842b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_651b1530dae3af8e37672c35d0d7d48c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_858fd9b58e776a528c47732bceacecb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_d299b34b99561e89daaaa191961ac2bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_87d5dbf700b82afb282fb7bdde45a8f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_652569751c8e8c3a668b185355d1f920.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_ea600699e2617b5c6128ba495436a688.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_7b825c4de6db73d9cd9fe6d372bc9662.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_9b59ff7c7a241c3b9c20de4ae98314b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c6a85bdebfa99ad9f351daef274fbc36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_3543718295c6d4717a1e37d2f205d14b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_777d05bc4abc30d8c679f3d86b50e752.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_8180f21b43405c2075463d16b4be38ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_c8342868964933e4dfb683aa3242ee5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfe8ee4-c23e-552c-95a7-4d1036ca3c22/9bfe8ee4-c23e-552c-95a7-4d1036ca3c22_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc0/84/c0848bab0058795ad3855ffc1639f734/pa/AB97785_1bc958750910334cb8c838948f20000c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2017}
2025-12-05 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB97785%27 HTTP/1.1" 200 None
2025-12-05 17:07:45 [auto1.fr] INFO: Saving data for AB97785: {'created_time': 1764954465.088752, 'last_price_update_time': 1764954465.088761, 'auction_closing_time': 1765039976.0}
2025-12-05 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB97785') HTTP/1.1" 204 0
2025-12-05 17:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV76318> (referer: https://www.auto1.com/v1/car-details-view/ZV76318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66288a38-49af-523e-b9f6-00083a1dc563 with identifier: ZV76318
2025-12-05 17:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66288a38-49af-523e-b9f6-00083a1dc563 with scrape type 1
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_73916adc51dd625cab22b85edf216668.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_73916adc51dd625cab22b85edf216668.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_c982123ba6befa82bdb8a649b9d2387d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c982123ba6befa82bdb8a649b9d2387d.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_b20f04f44b13c72512b6b5b4ab2752fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_b20f04f44b13c72512b6b5b4ab2752fa.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_148cfd45c7c0b6d007b3fdbef5672e63.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_148cfd45c7c0b6d007b3fdbef5672e63.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_0255282317e414bb15f84fde9d6564f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_0255282317e414bb15f84fde9d6564f4.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_80e1542937604ad7aca4046a491cfb5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_80e1542937604ad7aca4046a491cfb5f.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_127fbaab0c9626bf10c22f285ae40d12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_127fbaab0c9626bf10c22f285ae40d12.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_81fc131aa78ead8e4a462b3b9fc4952e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_81fc131aa78ead8e4a462b3b9fc4952e.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_2776fcca7610bbce6a6d2856895693b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2776fcca7610bbce6a6d2856895693b3.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_c64dd6366434c0150027d2380f08a3b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c64dd6366434c0150027d2380f08a3b9.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_7f2ebd7d229b9e26bb9f8a370fd593fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_7f2ebd7d229b9e26bb9f8a370fd593fc.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_4f3be4f67cc21487bf57a7ac8e4def6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_4f3be4f67cc21487bf57a7ac8e4def6f.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_a12c77d35b3cc3967d1deaac7419b202.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_a12c77d35b3cc3967d1deaac7419b202.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_ae30842d3b065f848a157f47663bd23f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_ae30842d3b065f848a157f47663bd23f.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_44f459e56908fe3990beb5fc507c05cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_44f459e56908fe3990beb5fc507c05cc.jpg not downloaded yet
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_2e53219b27d4c3a8fa4dee97d72401e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2e53219b27d4c3a8fa4dee97d72401e6.jpg not downloaded yet
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM02151> (referer: https://www.auto1.com/v1/car-details-view/JM02151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2e53219b27d4c3a8fa4dee97d72401e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271adc28-4fe1-5218-a88e-9957fa3caae0 with identifier: JM02151
2025-12-05 17:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271adc28-4fe1-5218-a88e-9957fa3caae0 with scrape type 2
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 271adc28-4fe1-5218-a88e-9957fa3caae0 with scrape type 2
2025-12-05 17:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 271adc28-4fe1-5218-a88e-9957fa3caae0, identifier: JM02151
2025-12-05 17:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 271adc28-4fe1-5218-a88e-9957fa3caae0 with identifier: JM02151
2025-12-05 17:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 271adc28-4fe1-5218-a88e-9957fa3caae0 with identifier: JM02151
2025-12-05 17:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 271adc28-4fe1-5218-a88e-9957fa3caae0 with identifier: JM02151 to the API
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM02151>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 309,
'expiration_date': '2025-12-06T16:39:02Z',
'fuel_type': 'hybrid',
'id': '271adc28-4fe1-5218-a88e-9957fa3caae0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM02151',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 116529,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque P300e Hybrid R-Dynamic',
'transmission': 'automatic',
'trim': 'R-Dynamic',
'year': 2021}
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM02151%27 HTTP/1.1" 200 None
2025-12-05 17:07:49 [auto1.fr] INFO: Saving data for JM02151: {'auction_closing_time': 1765039142.0, 'created_time': 1763572154.381502, 'last_price_update_time': 1764954469.597234}
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM02151') HTTP/1.1" 204 0
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_44f459e56908fe3990beb5fc507c05cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV38255> (referer: https://www.auto1.com/v1/car-details-view/SV38255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5789fd0>
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_2e53219b27d4c3a8fa4dee97d72401e6.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2e53219b27d4c3a8fa4dee97d72401e6.jpg saved to cache
2025-12-05 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_ae30842d3b065f848a157f47663bd23f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd5b50>
2025-12-05 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_44f459e56908fe3990beb5fc507c05cc.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_44f459e56908fe3990beb5fc507c05cc.jpg saved to cache
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502aaa6a-605e-59e0-9222-b04c35670cad with identifier: SV38255
2025-12-05 17:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502aaa6a-605e-59e0-9222-b04c35670cad with scrape type 2
2025-12-05 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 502aaa6a-605e-59e0-9222-b04c35670cad with scrape type 2
2025-12-05 17:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 502aaa6a-605e-59e0-9222-b04c35670cad, identifier: SV38255
2025-12-05 17:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 502aaa6a-605e-59e0-9222-b04c35670cad with identifier: SV38255
2025-12-05 17:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 502aaa6a-605e-59e0-9222-b04c35670cad with identifier: SV38255
2025-12-05 17:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 502aaa6a-605e-59e0-9222-b04c35670cad with identifier: SV38255 to the API
2025-12-05 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV38255>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 290,
'expiration_date': '2025-12-06T16:04:44Z',
'fuel_type': 'petrol',
'id': '502aaa6a-605e-59e0-9222-b04c35670cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV38255',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 59270,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV38255%27 HTTP/1.1" 200 None
2025-12-05 17:07:52 [auto1.fr] INFO: Saving data for SV38255: {'auction_closing_time': 1765037084.0, 'created_time': 1763658848.482289, 'last_price_update_time': 1764954472.668691}
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV38255') HTTP/1.1" 204 0
2025-12-05 17:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_a12c77d35b3cc3967d1deaac7419b202.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b24710>
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_ae30842d3b065f848a157f47663bd23f.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_ae30842d3b065f848a157f47663bd23f.jpg saved to cache
2025-12-05 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3cd10>
2025-12-05 17:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_a12c77d35b3cc3967d1deaac7419b202.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_a12c77d35b3cc3967d1deaac7419b202.jpg saved to cache
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_7f2ebd7d229b9e26bb9f8a370fd593fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_4f3be4f67cc21487bf57a7ac8e4def6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3f050>
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_7f2ebd7d229b9e26bb9f8a370fd593fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_7f2ebd7d229b9e26bb9f8a370fd593fc.jpg saved to cache
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d22690>
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_4f3be4f67cc21487bf57a7ac8e4def6f.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_4f3be4f67cc21487bf57a7ac8e4def6f.jpg saved to cache
2025-12-05 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE02662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c64dd6366434c0150027d2380f08a3b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2776fcca7610bbce6a6d2856895693b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf8310>
2025-12-05 17:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_c64dd6366434c0150027d2380f08a3b9.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c64dd6366434c0150027d2380f08a3b9.jpg saved to cache
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5877b10>
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_2776fcca7610bbce6a6d2856895693b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2776fcca7610bbce6a6d2856895693b3.jpg saved to cache
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF51092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF20432> (referer: https://www.auto1.com/v1/car-details-view/SF20432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:54 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:54 [auto1.fr] INFO: Found listing with ID: SV38255
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV38255%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.fr] INFO: Scrape type for SV38255: 0
2025-12-05 17:07:54 [auto1.fr] INFO: Found listing with ID: SE39749
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE39749%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.fr] INFO: Scrape type for SE39749: 0
2025-12-05 17:07:54 [auto1.fr] INFO: Found listing with ID: FM83713
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM83713%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.fr] INFO: Scrape type for FM83713: 2
2025-12-05 17:07:54 [auto1.fr] INFO: Found listing with ID: XJ29729
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ29729%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.fr] INFO: Scrape type for XJ29729: 2
2025-12-05 17:07:54 [auto1.fr] INFO: Found listing with ID: HA88134
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA88134%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.fr] INFO: Scrape type for HA88134: 2
2025-12-05 17:07:54 [auto1.fr] INFO: Found listing with ID: LE99013
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE99013%27 HTTP/1.1" 200 None
2025-12-05 17:07:54 [auto1.fr] INFO: Scrape type for LE99013: 2
2025-12-05 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_148cfd45c7c0b6d007b3fdbef5672e63.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34904871-9e9c-5137-87c2-91a020c1b927 with identifier: SF20432
2025-12-05 17:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34904871-9e9c-5137-87c2-91a020c1b927 with scrape type 2
2025-12-05 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34904871-9e9c-5137-87c2-91a020c1b927 with scrape type 2
2025-12-05 17:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 34904871-9e9c-5137-87c2-91a020c1b927, identifier: SF20432
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: GF19917
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF19917%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for GF19917: 2
2025-12-05 17:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 34904871-9e9c-5137-87c2-91a020c1b927 with identifier: SF20432
2025-12-05 17:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 34904871-9e9c-5137-87c2-91a020c1b927 with identifier: SF20432
2025-12-05 17:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173261 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173261
2025-12-05 17:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 34904871-9e9c-5137-87c2-91a020c1b927 spider: auto1.fr
2025-12-05 17:07:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 34904871-9e9c-5137-87c2-91a020c1b927 due to rule: high_mileage_for_country.json, error: 173261 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173261
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 210,
'expiration_date': '2025-12-06T16:31:02Z',
'fuel_type': 'diesel',
'id': '34904871-9e9c-5137-87c2-91a020c1b927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF20432',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Ford',
'model': 'Edge',
'odometer': 173261,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-25',
'seats_number': 2,
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi Bi-Turbo Titanium 4x4',
'transmission': 'automatic',
'trim': 'Titanium 4x4',
'year': 2018}
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF20432%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Saving data for SF20432: {'auction_closing_time': 1765038662.0, 'created_time': 1764781223.162349, 'last_price_update_time': 1764954475.235922}
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SF20432') HTTP/1.1" 204 0
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_80e1542937604ad7aca4046a491cfb5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: JB85417
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB85417%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for JB85417: 2
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583d810>
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_148cfd45c7c0b6d007b3fdbef5672e63.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_148cfd45c7c0b6d007b3fdbef5672e63.jpg saved to cache
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: VS24035
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS24035%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for VS24035: 2
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: FF55023
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF55023%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for FF55023: 1
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH03574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5810a90>
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_80e1542937604ad7aca4046a491cfb5f.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_80e1542937604ad7aca4046a491cfb5f.jpg saved to cache
2025-12-05 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: UK31452
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK31452%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for UK31452: 1
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_81fc131aa78ead8e4a462b3b9fc4952e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: EW91443
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW91443%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for EW91443: 2
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: FT21371
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT21371%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for FT21371: 1
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: YS07097
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS07097%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for YS07097: 2
2025-12-05 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_127fbaab0c9626bf10c22f285ae40d12.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: XS94579
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS94579%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for XS94579: 2
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: EE79287
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE79287%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for EE79287: 2
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: SG30804
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG30804%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for SG30804: 2
2025-12-05 17:07:55 [auto1.fr] INFO: Found listing with ID: NE87463
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE87463%27 HTTP/1.1" 200 None
2025-12-05 17:07:55 [auto1.fr] INFO: Scrape type for NE87463: 2
2025-12-05 17:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c81ed0>
2025-12-05 17:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_81fc131aa78ead8e4a462b3b9fc4952e.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_81fc131aa78ead8e4a462b3b9fc4952e.jpg saved to cache
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: GJ62360
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ62360%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for GJ62360: 2
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: CH38198
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH38198%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for CH38198: 2
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: YT74756
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT74756%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for YT74756: 2
2025-12-05 17:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a23d90>
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_127fbaab0c9626bf10c22f285ae40d12.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_127fbaab0c9626bf10c22f285ae40d12.jpg saved to cache
2025-12-05 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: GP91429
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP91429%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for GP91429: 2
2025-12-05 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU35466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ62641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: HE77297
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE77297%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for HE77297: 2
2025-12-05 17:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: VS47593
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS47593%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for VS47593: 1
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: HK03236
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK03236%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for HK03236: 1
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: LE58838
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE58838%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for LE58838: 1
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: FS09110
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS09110%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for FS09110: 1
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: DB62921
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB62921%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for DB62921: 1
2025-12-05 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_0255282317e414bb15f84fde9d6564f4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: TD98246
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD98246%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for TD98246: 1
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: VX68116
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX68116%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for VX68116: 2
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: KV05125
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV05125%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for KV05125: 2
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: WU26238
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU26238%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for WU26238: 1
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: WU43983
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU43983%27 HTTP/1.1" 200 None
2025-12-05 17:07:56 [auto1.fr] INFO: Scrape type for WU43983: 2
2025-12-05 17:07:56 [auto1.fr] INFO: Found listing with ID: BM17009
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM17009%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for BM17009: 1
2025-12-05 17:07:57 [auto1.fr] INFO: Found listing with ID: TR31605
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR31605%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for TR31605: 1
2025-12-05 17:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f7d50>
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_0255282317e414bb15f84fde9d6564f4.jpg') HTTP/1.1" 204 0
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_0255282317e414bb15f84fde9d6564f4.jpg saved to cache
2025-12-05 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:07:57 [auto1.fr] INFO: Found listing with ID: WU68927
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU68927%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for WU68927: 2
2025-12-05 17:07:57 [auto1.fr] INFO: Found listing with ID: MX88622
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX88622%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for MX88622: 1
2025-12-05 17:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF89576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:57 [auto1.fr] INFO: Found listing with ID: LD83766
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD83766%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for LD83766: 1
2025-12-05 17:07:57 [auto1.fr] INFO: Found listing with ID: SW38104
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW38104%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for SW38104: 1
2025-12-05 17:07:57 [auto1.fr] INFO: Found listing with ID: BX73985
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX73985%27 HTTP/1.1" 200 None
2025-12-05 17:07:57 [auto1.fr] INFO: Scrape type for BX73985: 2
2025-12-05 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA88134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF19917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF55023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS24035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU21590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE02662> (referer: https://www.auto1.com/v1/car-details-view/DE02662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52a0fb0f-518f-5af8-87df-40b6353b8cde with identifier: DE02662
2025-12-05 17:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52a0fb0f-518f-5af8-87df-40b6353b8cde with scrape type 1
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 52a0fb0f-518f-5af8-87df-40b6353b8cde
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_19116d7b91982c7d9da42aaae0e1720e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg already downloaded
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg already downloaded
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_45d5674c32b5759eb67e067a6e822eb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg already downloaded
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_c0be419be5fc039920c2f9d35c55401e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg already downloaded
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg already downloaded
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg already downloaded
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_88361d3f29af6fbff156b56f1290378e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_4d33d476c36c778aed1521c59f12cfe0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_57308e137b92abb13e6eec9ae7094384.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_a69867461d0020810fc960265f56f208.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_53078d949728ca423a97aa12c62240ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg already downloaded
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F75%252F417526ad8b8dfbe1ffcfbdbb7f1d9758%252Fpa%252FDE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg already downloaded
2025-12-05 17:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52a0fb0f-518f-5af8-87df-40b6353b8cde, identifier: DE02662
2025-12-05 17:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52a0fb0f-518f-5af8-87df-40b6353b8cde with identifier: DE02662
2025-12-05 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52a0fb0f-518f-5af8-87df-40b6353b8cde with identifier: DE02662
2025-12-05 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 25822, 'odometer_reading_unit': 'km', 'registration_date': '2023-11-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de02662', 'expiration_date': '2025-12-06t16:15:53z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 150, 'id': '52a0fb0f-518f-5af8-87df-40b6353b8cde', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80801}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77475}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68255}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61291}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72598}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2692883}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66870}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53942}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69010}], 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 25822}
Failed validating None in schema:
False
On instance:
{'age_in_months': 24,
'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:15:53z',
'fuel_type': 'petrol',
'id': '52a0fb0f-518f-5af8-87df-40b6353b8cde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de02662',
'listing': 'auction',
'location': 'fr, villenoy',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 25822,
'odometer_in_km': 25822,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692883,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-13',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
2025-12-05 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 52a0fb0f-518f-5af8-87df-40b6353b8cde spider: auto1.fr
2025-12-05 17:08:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 52a0fb0f-518f-5af8-87df-40b6353b8cde due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 25822, 'odometer_reading_unit': 'km', 'registration_date': '2023-11-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de02662', 'expiration_date': '2025-12-06t16:15:53z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg', 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 150, 'id': '52a0fb0f-518f-5af8-87df-40b6353b8cde', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80801}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77475}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68255}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61291}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72598}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2692883}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 84222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66870}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53942}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 100448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69010}], 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 25822}
Failed validating None in schema:
False
On instance:
{'age_in_months': 24,
'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:15:53z',
'fuel_type': 'petrol',
'id': '52a0fb0f-518f-5af8-87df-40b6353b8cde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/de02662',
'listing': 'auction',
'location': 'fr, villenoy',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 25822,
'odometer_in_km': 25822,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692883,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-13',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:15:53Z',
'fuel_type': 'petrol',
'id': '52a0fb0f-518f-5af8-87df-40b6353b8cde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE02662',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Peugeot',
'model': '5008',
'odometer': 25822,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg',
'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_19116d7b91982c7d9da42aaae0e1720e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1ff868da4b5dc49b2d59f9f2308df9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_45d5674c32b5759eb67e067a6e822eb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c0be419be5fc039920c2f9d35c55401e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_c350321ee00e0df6a5f0ceefce4cde37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_fe9cea802a6661a74c1ffeda89ae8051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_1be5599e2ac51aca8b84edda3dd41acb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692883,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_88361d3f29af6fbff156b56f1290378e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_4d33d476c36c778aed1521c59f12cfe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_ed6ed1c1bc2dc652076d5a5977afe096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_57308e137b92abb13e6eec9ae7094384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a0931eaeb2d029ce39d189dad42e2b62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_08ed57cf2b4f2f6aa5d046d4e7c7cba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_a69867461d0020810fc960265f56f208.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_53078d949728ca423a97aa12c62240ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55777060-ee52-59eb-8181-238378f9098c/55777060-ee52-59eb-8181-238378f9098c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/75/417526ad8b8dfbe1ffcfbdbb7f1d9758/pa/DE02662_9f3f47fb648e65b1a36047b04e3fe650.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-13',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE02662%27 HTTP/1.1" 200 None
2025-12-05 17:08:08 [auto1.fr] INFO: Saving data for DE02662: {'created_time': 1764954488.665861, 'last_price_update_time': 1764954488.665872, 'auction_closing_time': 1765037753.0}
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE02662') HTTP/1.1" 204 0
2025-12-05 17:08:08 [scrapy.extensions.logstats] INFO: Crawled 662 pages (at 27 pages/min), scraped 154 items (at 4 items/min)
2025-12-05 17:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP91429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ62360/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX88622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB06065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN65499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT27070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ62641> (referer: https://www.auto1.com/v1/car-details-view/DJ62641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70b19ea-8737-5231-b72d-8a8b849b3f07 with identifier: DJ62641
2025-12-05 17:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70b19ea-8737-5231-b72d-8a8b849b3f07 with scrape type 2
2025-12-05 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b70b19ea-8737-5231-b72d-8a8b849b3f07 with scrape type 2
2025-12-05 17:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b70b19ea-8737-5231-b72d-8a8b849b3f07, identifier: DJ62641
2025-12-05 17:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b70b19ea-8737-5231-b72d-8a8b849b3f07 with identifier: DJ62641
2025-12-05 17:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b70b19ea-8737-5231-b72d-8a8b849b3f07 with identifier: DJ62641
2025-12-05 17:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b70b19ea-8737-5231-b72d-8a8b849b3f07 with identifier: DJ62641 to the API
2025-12-05 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ62641>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 205,
'expiration_date': '2025-12-06T16:54:57Z',
'fuel_type': 'petrol',
'id': 'b70b19ea-8737-5231-b72d-8a8b849b3f07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ62641',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '308',
'odometer': 111721,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-10',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 THP GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2016}
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ62641%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [auto1.fr] INFO: Saving data for DJ62641: {'auction_closing_time': 1765040097.0, 'created_time': 1761584958.832515, 'last_price_update_time': 1764954494.304864}
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ62641') HTTP/1.1" 204 0
2025-12-05 17:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT74756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY21040> (referer: https://www.auto1.com/v1/car-details-view/TY21040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee8cb46-cc22-5497-abc4-db0d8390ff69 with identifier: TY21040
2025-12-05 17:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee8cb46-cc22-5497-abc4-db0d8390ff69 with scrape type 2
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ee8cb46-cc22-5497-abc4-db0d8390ff69 with scrape type 2
2025-12-05 17:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ee8cb46-cc22-5497-abc4-db0d8390ff69, identifier: TY21040
2025-12-05 17:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ee8cb46-cc22-5497-abc4-db0d8390ff69 with identifier: TY21040
2025-12-05 17:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ee8cb46-cc22-5497-abc4-db0d8390ff69 with identifier: TY21040
2025-12-05 17:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ee8cb46-cc22-5497-abc4-db0d8390ff69 with identifier: TY21040 to the API
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY21040>
{'auction_title': '',
'c_o_2_emission_value': 34,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 245,
'expiration_date': '2025-12-06T16:46:35Z',
'fuel_type': 'hybrid',
'id': '4ee8cb46-cc22-5497-abc4-db0d8390ff69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY21040',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 67955,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY21040%27 HTTP/1.1" 200 None
2025-12-05 17:08:14 [auto1.fr] INFO: Saving data for TY21040: {'auction_closing_time': 1765039595.0, 'created_time': 1764004145.905308, 'last_price_update_time': 1764954494.847229}
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY21040') HTTP/1.1" 204 0
2025-12-05 17:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF19917> (referer: https://www.auto1.com/v1/car-details-view/GF19917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af7b4576-0bff-5110-b93e-2f0199a24591 with identifier: GF19917
2025-12-05 17:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af7b4576-0bff-5110-b93e-2f0199a24591 with scrape type 2
2025-12-05 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af7b4576-0bff-5110-b93e-2f0199a24591 with scrape type 2
2025-12-05 17:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: af7b4576-0bff-5110-b93e-2f0199a24591, identifier: GF19917
2025-12-05 17:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: af7b4576-0bff-5110-b93e-2f0199a24591 with identifier: GF19917
2025-12-05 17:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: af7b4576-0bff-5110-b93e-2f0199a24591 with identifier: GF19917
2025-12-05 17:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: af7b4576-0bff-5110-b93e-2f0199a24591 with identifier: GF19917 to the API
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF19917>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2025-12-06T16:44:11Z',
'fuel_type': 'hybrid',
'id': 'af7b4576-0bff-5110-b93e-2f0199a24591',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF19917',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Renault',
'model': 'Captur',
'odometer': 29592,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Techno Fast Track',
'transmission': 'automatic',
'trim': 'Techno Fast Track',
'year': 2023}
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF19917%27 HTTP/1.1" 200 None
2025-12-05 17:08:15 [auto1.fr] INFO: Saving data for GF19917: {'auction_closing_time': 1765039451.0, 'created_time': 1764669863.187224, 'last_price_update_time': 1764954495.671449}
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF19917') HTTP/1.1" 204 0
2025-12-05 17:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF55023> (referer: https://www.auto1.com/v1/car-details-view/FF55023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA88134> (referer: https://www.auto1.com/v1/car-details-view/HA88134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF89576> (referer: https://www.auto1.com/v1/car-details-view/EF89576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa with identifier: FF55023
2025-12-05 17:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa with scrape type 1
2025-12-05 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_cd1b0d37f014b146e3640e8b5b7afcfc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_cd1b0d37f014b146e3640e8b5b7afcfc.jpg not downloaded yet
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_3f75807d160dabe9e6364e904f49bc6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_3f75807d160dabe9e6364e904f49bc6d.jpg not downloaded yet
2025-12-05 17:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a7cfab-22a7-54af-8208-af8fbd2c8a6b with identifier: HA88134
2025-12-05 17:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a7cfab-22a7-54af-8208-af8fbd2c8a6b with scrape type 2
2025-12-05 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a7cfab-22a7-54af-8208-af8fbd2c8a6b with scrape type 2
2025-12-05 17:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 11a7cfab-22a7-54af-8208-af8fbd2c8a6b, identifier: HA88134
2025-12-05 17:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9166cd9e-f8ad-567a-b58d-d41caed0b30c with identifier: EF89576
2025-12-05 17:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9166cd9e-f8ad-567a-b58d-d41caed0b30c with scrape type 2
2025-12-05 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9166cd9e-f8ad-567a-b58d-d41caed0b30c with scrape type 2
2025-12-05 17:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9166cd9e-f8ad-567a-b58d-d41caed0b30c, identifier: EF89576
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_473f7aa1621fd66b30f9d25a5a0962fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_473f7aa1621fd66b30f9d25a5a0962fb.jpg not downloaded yet
2025-12-05 17:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 11a7cfab-22a7-54af-8208-af8fbd2c8a6b with identifier: HA88134
2025-12-05 17:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 11a7cfab-22a7-54af-8208-af8fbd2c8a6b with identifier: HA88134
2025-12-05 17:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'suzuki swift 1.2 dualjet mild-hybrid comfort', 'price': 0, 'currency': 'eur', 'make': 'suzuki', 'model': 'swift', 'transmission': 'manual', 'odometer': 86116, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha88134', 'expiration_date': '2025-12-06t16:28:28z', 'origin_country_code': 'fr', 'trim': 'comfort', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 83, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 111, 'id': '11a7cfab-22a7-54af-8208-af8fbd2c8a6b', 'current_year_diff': 5, 'age_in_months': 62, 'make_model': 'suzuki swift', 'sanitized_make': 'suzuki', 'odometer_in_km': 86116}
Failed validating None in schema:
False
On instance:
{'age_in_months': 62,
'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 83,
'expiration_date': '2025-12-06t16:28:28z',
'fuel_type': 'petrol',
'id': '11a7cfab-22a7-54af-8208-af8fbd2c8a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha88134',
'listing': 'auction',
'location': 'fr, nanteuil-le-haudouin',
'make': 'suzuki',
'make_model': 'suzuki swift',
'model': 'swift',
'odometer': 86116,
'odometer_in_km': 86116,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-06',
'sanitized_make': 'suzuki',
'seats_number': 5,
'seller_name': None,
'title': 'suzuki swift 1.2 dualjet mild-hybrid comfort',
'transmission': 'manual',
'trim': 'comfort',
'year': 2020}
2025-12-05 17:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 11a7cfab-22a7-54af-8208-af8fbd2c8a6b spider: auto1.fr
2025-12-05 17:08:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 11a7cfab-22a7-54af-8208-af8fbd2c8a6b due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'suzuki swift 1.2 dualjet mild-hybrid comfort', 'price': 0, 'currency': 'eur', 'make': 'suzuki', 'model': 'swift', 'transmission': 'manual', 'odometer': 86116, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha88134', 'expiration_date': '2025-12-06t16:28:28z', 'origin_country_code': 'fr', 'trim': 'comfort', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 83, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 111, 'id': '11a7cfab-22a7-54af-8208-af8fbd2c8a6b', 'current_year_diff': 5, 'age_in_months': 62, 'make_model': 'suzuki swift', 'sanitized_make': 'suzuki', 'odometer_in_km': 86116}
Failed validating None in schema:
False
On instance:
{'age_in_months': 62,
'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 83,
'expiration_date': '2025-12-06t16:28:28z',
'fuel_type': 'petrol',
'id': '11a7cfab-22a7-54af-8208-af8fbd2c8a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ha88134',
'listing': 'auction',
'location': 'fr, nanteuil-le-haudouin',
'make': 'suzuki',
'make_model': 'suzuki swift',
'model': 'swift',
'odometer': 86116,
'odometer_in_km': 86116,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-06',
'sanitized_make': 'suzuki',
'seats_number': 5,
'seller_name': None,
'title': 'suzuki swift 1.2 dualjet mild-hybrid comfort',
'transmission': 'manual',
'trim': 'comfort',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 83,
'expiration_date': '2025-12-06T16:28:28Z',
'fuel_type': 'petrol',
'id': '11a7cfab-22a7-54af-8208-af8fbd2c8a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88134',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 86116,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2020}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA88134%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [auto1.fr] INFO: Saving data for HA88134: {'auction_closing_time': 1765038508.0, 'created_time': 1764176573.503093, 'last_price_update_time': 1764954496.247907}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA88134') HTTP/1.1" 204 0
2025-12-05 17:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9166cd9e-f8ad-567a-b58d-d41caed0b30c with identifier: EF89576
2025-12-05 17:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9166cd9e-f8ad-567a-b58d-d41caed0b30c with identifier: EF89576
2025-12-05 17:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9166cd9e-f8ad-567a-b58d-d41caed0b30c with identifier: EF89576 to the API
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%279166cd9e-f8ad-567a-b58d-d41caed0b30c%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.pipelines.post_to_api] ERROR: auto1.fr, item_id 9166cd9e-f8ad-567a-b58d-d41caed0b30c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
| Status Code: 422
| Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
| Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 17:08:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}
2025-12-05 17:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF89576>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 204,
'expiration_date': '2025-12-06T16:59:36Z',
'fuel_type': 'hybrid',
'id': '9166cd9e-f8ad-567a-b58d-d41caed0b30c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF89576',
'listing': 'auction',
'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 42021,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 40 TFSIe S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF89576%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [auto1.fr] INFO: Saving data for EF89576: {'auction_closing_time': 1765040376.0, 'created_time': 1764237757.969294, 'last_price_update_time': 1764954496.585104}
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF89576') HTTP/1.1" 204 0
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_5dad2d7ea329cd3451f84f44a84de616.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5dad2d7ea329cd3451f84f44a84de616.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_9643e897a92c9afd673b9707afb487f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_9643e897a92c9afd673b9707afb487f7.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_d77f71ea4954d1860b765644a5d99cb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_d77f71ea4954d1860b765644a5d99cb2.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_5777db8690f594e3a18c1f3b43c6c85b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5777db8690f594e3a18c1f3b43c6c85b.jpg not downloaded yet
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX73985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_ff271c7b536a62071a068decf99551af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_ff271c7b536a62071a068decf99551af.jpg not downloaded yet
2025-12-05 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_80a7d9caf9add0b1d207829c41ba919c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_80a7d9caf9add0b1d207829c41ba919c.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_6feeccbdad32f08f6d37d6e82527e65a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_6feeccbdad32f08f6d37d6e82527e65a.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_073a59f6f7fed17a933fb6e4d6209ff2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_073a59f6f7fed17a933fb6e4d6209ff2.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_b2ea967e9ae75d70e4a9716a7cee3435.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b2ea967e9ae75d70e4a9716a7cee3435.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_694b638447e0f4c1448d0c9d80ad34c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_694b638447e0f4c1448d0c9d80ad34c6.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_a3d9062ddaa53a92f58bc30e38bb7c9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_a3d9062ddaa53a92f58bc30e38bb7c9f.jpg not downloaded yet
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5777db8690f594e3a18c1f3b43c6c85b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_01355e9a3dbd769233e7c9814aca40b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_01355e9a3dbd769233e7c9814aca40b8.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_bb0aadbc1196c476392585f9ce5fbb8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_bb0aadbc1196c476392585f9ce5fbb8c.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_b7772a7562aeef7026d3cd3d38090d5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b7772a7562aeef7026d3cd3d38090d5b.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_51c7da5e46d4f3f732e14589b73e5535.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_51c7da5e46d4f3f732e14589b73e5535.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_89f54ccd052df9f35b2aef4665c123d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_89f54ccd052df9f35b2aef4665c123d3.jpg not downloaded yet
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_7691eef1ad6166e240267107971137f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_7691eef1ad6166e240267107971137f3.jpg not downloaded yet
2025-12-05 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_a3d9062ddaa53a92f58bc30e38bb7c9f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e76d90>
2025-12-05 17:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_5777db8690f594e3a18c1f3b43c6c85b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5777db8690f594e3a18c1f3b43c6c85b.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4caeed0>
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_a3d9062ddaa53a92f58bc30e38bb7c9f.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_a3d9062ddaa53a92f58bc30e38bb7c9f.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_7691eef1ad6166e240267107971137f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS24035> (referer: https://www.auto1.com/v1/car-details-view/VS24035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_89f54ccd052df9f35b2aef4665c123d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_51c7da5e46d4f3f732e14589b73e5535.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b7772a7562aeef7026d3cd3d38090d5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_bb0aadbc1196c476392585f9ce5fbb8c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e37d0>
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_7691eef1ad6166e240267107971137f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_7691eef1ad6166e240267107971137f3.jpg saved to cache
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1753ffe4-4985-5bcf-bc4e-35699af16ddb with identifier: VS24035
2025-12-05 17:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1753ffe4-4985-5bcf-bc4e-35699af16ddb with scrape type 2
2025-12-05 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1753ffe4-4985-5bcf-bc4e-35699af16ddb with scrape type 2
2025-12-05 17:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1753ffe4-4985-5bcf-bc4e-35699af16ddb, identifier: VS24035
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ee6690>
2025-12-05 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_89f54ccd052df9f35b2aef4665c123d3.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_89f54ccd052df9f35b2aef4665c123d3.jpg saved to cache
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f09410>
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_51c7da5e46d4f3f732e14589b73e5535.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_51c7da5e46d4f3f732e14589b73e5535.jpg saved to cache
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e68a50>
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_b7772a7562aeef7026d3cd3d38090d5b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b7772a7562aeef7026d3cd3d38090d5b.jpg saved to cache
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f09790>
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_bb0aadbc1196c476392585f9ce5fbb8c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_bb0aadbc1196c476392585f9ce5fbb8c.jpg saved to cache
2025-12-05 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1753ffe4-4985-5bcf-bc4e-35699af16ddb with identifier: VS24035
2025-12-05 17:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1753ffe4-4985-5bcf-bc4e-35699af16ddb with identifier: VS24035
2025-12-05 17:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 119518, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs24035', 'expiration_date': '2025-12-06t16:18:57z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 143, 'id': '1753ffe4-4985-5bcf-bc4e-35699af16ddb', 'current_year_diff': 5, 'age_in_months': 66, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 119518}
Failed validating None in schema:
False
On instance:
{'age_in_months': 66,
'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:18:57z',
'fuel_type': 'petrol',
'id': '1753ffe4-4985-5bcf-bc4e-35699af16ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs24035',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 119518,
'odometer_in_km': 119518,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-27',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2020}
2025-12-05 17:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1753ffe4-4985-5bcf-bc4e-35699af16ddb spider: auto1.fr
2025-12-05 17:08:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1753ffe4-4985-5bcf-bc4e-35699af16ddb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 119518, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs24035', 'expiration_date': '2025-12-06t16:18:57z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 143, 'id': '1753ffe4-4985-5bcf-bc4e-35699af16ddb', 'current_year_diff': 5, 'age_in_months': 66, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 119518}
Failed validating None in schema:
False
On instance:
{'age_in_months': 66,
'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:18:57z',
'fuel_type': 'petrol',
'id': '1753ffe4-4985-5bcf-bc4e-35699af16ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs24035',
'listing': 'auction',
'location': 'fr, marly-la-ville',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 119518,
'odometer_in_km': 119518,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-27',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:18:57Z',
'fuel_type': 'petrol',
'id': '1753ffe4-4985-5bcf-bc4e-35699af16ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS24035',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 119518,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2020}
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS24035%27 HTTP/1.1" 200 None
2025-12-05 17:08:18 [auto1.fr] INFO: Saving data for VS24035: {'auction_closing_time': 1765037937.0, 'created_time': 1764003977.615161, 'last_price_update_time': 1764954498.982925}
2025-12-05 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS24035') HTTP/1.1" 204 0
2025-12-05 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_01355e9a3dbd769233e7c9814aca40b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ62360> (referer: https://www.auto1.com/v1/car-details-view/GJ62360/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b2ea967e9ae75d70e4a9716a7cee3435.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_694b638447e0f4c1448d0c9d80ad34c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1bd50>
2025-12-05 17:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_01355e9a3dbd769233e7c9814aca40b8.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_01355e9a3dbd769233e7c9814aca40b8.jpg saved to cache
2025-12-05 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de749873-005f-50ab-92f4-3d70c32c7d06 with identifier: GJ62360
2025-12-05 17:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de749873-005f-50ab-92f4-3d70c32c7d06 with scrape type 2
2025-12-05 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de749873-005f-50ab-92f4-3d70c32c7d06 with scrape type 2
2025-12-05 17:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de749873-005f-50ab-92f4-3d70c32c7d06, identifier: GJ62360
2025-12-05 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_073a59f6f7fed17a933fb6e4d6209ff2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de749873-005f-50ab-92f4-3d70c32c7d06 with identifier: GJ62360
2025-12-05 17:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de749873-005f-50ab-92f4-3d70c32c7d06 with identifier: GJ62360
2025-12-05 17:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: de749873-005f-50ab-92f4-3d70c32c7d06 with identifier: GJ62360 to the API
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GJ62360>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:22:50Z',
'fuel_type': 'diesel',
'id': 'de749873-005f-50ab-92f4-3d70c32c7d06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ62360',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 142583,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TDI R-Line Exclusive 4Motion',
'transmission': 'automatic',
'trim': 'R-Line Exclusive 4Motion',
'year': 2018}
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ62360%27 HTTP/1.1" 200 None
2025-12-05 17:08:19 [auto1.fr] INFO: Saving data for GJ62360: {'auction_closing_time': 1765038170.0, 'created_time': 1763745442.040301, 'last_price_update_time': 1764954499.971752}
2025-12-05 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GJ62360') HTTP/1.1" 204 0
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_6feeccbdad32f08f6d37d6e82527e65a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578ff50>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_b2ea967e9ae75d70e4a9716a7cee3435.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b2ea967e9ae75d70e4a9716a7cee3435.jpg saved to cache
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3dfd0>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_694b638447e0f4c1448d0c9d80ad34c6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_694b638447e0f4c1448d0c9d80ad34c6.jpg saved to cache
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58dc390>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_073a59f6f7fed17a933fb6e4d6209ff2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_073a59f6f7fed17a933fb6e4d6209ff2.jpg saved to cache
2025-12-05 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_ff271c7b536a62071a068decf99551af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_80a7d9caf9add0b1d207829c41ba919c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57dce90>
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_6feeccbdad32f08f6d37d6e82527e65a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_6feeccbdad32f08f6d37d6e82527e65a.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT27070> (referer: https://www.auto1.com/v1/car-details-view/UT27070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB06065> (referer: https://www.auto1.com/v1/car-details-view/CB06065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea39d0>
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_ff271c7b536a62071a068decf99551af.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_ff271c7b536a62071a068decf99551af.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb5a10>
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_80a7d9caf9add0b1d207829c41ba919c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_80a7d9caf9add0b1d207829c41ba919c.jpg saved to cache
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_d77f71ea4954d1860b765644a5d99cb2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_9643e897a92c9afd673b9707afb487f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW38104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e68dd25-bfae-5870-8f15-281f5ec8bd44 with identifier: UT27070
2025-12-05 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44 with scrape type 1
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_250e5faede9eae98c6ffd1b8620cb378.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg not downloaded yet
2025-12-05 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ec4005a-e801-5975-b30b-721d8c65ebbc with identifier: CB06065
2025-12-05 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ec4005a-e801-5975-b30b-721d8c65ebbc with scrape type 2
2025-12-05 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ec4005a-e801-5975-b30b-721d8c65ebbc with scrape type 2
2025-12-05 17:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ec4005a-e801-5975-b30b-721d8c65ebbc, identifier: CB06065
2025-12-05 17:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ec4005a-e801-5975-b30b-721d8c65ebbc with identifier: CB06065
2025-12-05 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ec4005a-e801-5975-b30b-721d8c65ebbc with identifier: CB06065
2025-12-05 17:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ec4005a-e801-5975-b30b-721d8c65ebbc with identifier: CB06065 to the API
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB06065>
{'auction_title': '',
'c_o_2_emission_value': 84,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:24:27Z',
'fuel_type': 'hybrid',
'id': '3ec4005a-e801-5975-b30b-721d8c65ebbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB06065',
'listing': 'auction',
'location': 'FR',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 59195,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2019}
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB06065%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [auto1.fr] INFO: Saving data for CB06065: {'auction_closing_time': 1765038267.0, 'created_time': 1764608734.447916, 'last_price_update_time': 1764954502.038267}
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB06065') HTTP/1.1" 204 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_c58da11633f79e2021a4776e25181644.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg not downloaded yet
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e83550>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_d77f71ea4954d1860b765644a5d99cb2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_d77f71ea4954d1860b765644a5d99cb2.jpg saved to cache
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1f390>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_9643e897a92c9afd673b9707afb487f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_9643e897a92c9afd673b9707afb487f7.jpg saved to cache
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5dad2d7ea329cd3451f84f44a84de616.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_473f7aa1621fd66b30f9d25a5a0962fb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg not downloaded yet
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF13728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_cd1b0d37f014b146e3640e8b5b7afcfc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_3f75807d160dabe9e6364e904f49bc6d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_98ed796b74a5f802ab56c176c5238de1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg not downloaded yet
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_d696db610464cabbc2ed7d3bbc5df610.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg not downloaded yet
2025-12-05 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_c768f5bc7635bc561e5701bb07796980.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg not downloaded yet
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7fb50>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_5dad2d7ea329cd3451f84f44a84de616.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5dad2d7ea329cd3451f84f44a84de616.jpg saved to cache
2025-12-05 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c53e10>
2025-12-05 17:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_473f7aa1621fd66b30f9d25a5a0962fb.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_473f7aa1621fd66b30f9d25a5a0962fb.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_8e80c30ffa759711f9e757125504480a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg not downloaded yet
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59992d0>
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_cd1b0d37f014b146e3640e8b5b7afcfc.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_cd1b0d37f014b146e3640e8b5b7afcfc.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58800d0>
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F71%252F0971ec0e1e71621525f40c9046625041%252Fpa%252FFF55023_3f75807d160dabe9e6364e904f49bc6d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_3f75807d160dabe9e6364e904f49bc6d.jpg saved to cache
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa
2025-12-05 17:08:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa, skipping ID generation
2025-12-05 17:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa with scrape type 1
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa from tracking dictionaries
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa sending to next pipeline
2025-12-05 17:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa, identifier: FF55023
2025-12-05 17:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_bed3c3d9dc2592775a3d89cc43542778.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg not downloaded yet
2025-12-05 17:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa with identifier: FF55023
2025-12-05 17:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa with identifier: FF55023
2025-12-05 17:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153509 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153509
2025-12-05 17:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa spider: auto1.fr
2025-12-05 17:08:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa due to rule: high_mileage_for_country.json, error: 153509 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153509
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:01:51Z',
'fuel_type': 'diesel',
'id': '2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF55023',
'listing': 'auction',
'location': 'FR',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 153509,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_cd1b0d37f014b146e3640e8b5b7afcfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_3f75807d160dabe9e6364e904f49bc6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_473f7aa1621fd66b30f9d25a5a0962fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5dad2d7ea329cd3451f84f44a84de616.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_9643e897a92c9afd673b9707afb487f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_d77f71ea4954d1860b765644a5d99cb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_5777db8690f594e3a18c1f3b43c6c85b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_ff271c7b536a62071a068decf99551af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_80a7d9caf9add0b1d207829c41ba919c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_6feeccbdad32f08f6d37d6e82527e65a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_073a59f6f7fed17a933fb6e4d6209ff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b2ea967e9ae75d70e4a9716a7cee3435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_694b638447e0f4c1448d0c9d80ad34c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_a3d9062ddaa53a92f58bc30e38bb7c9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_01355e9a3dbd769233e7c9814aca40b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_bb0aadbc1196c476392585f9ce5fbb8c.jpg',
'Width': 495},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24913,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_b7772a7562aeef7026d3cd3d38090d5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23762,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_51c7da5e46d4f3f732e14589b73e5535.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35127,
'Height': 564,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_89f54ccd052df9f35b2aef4665c123d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa/2c4f2ac9-23c0-51b6-b3af-157f5bbd69fa_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/71/0971ec0e1e71621525f40c9046625041/pa/FF55023_7691eef1ad6166e240267107971137f3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2018}
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF55023%27 HTTP/1.1" 200 None
2025-12-05 17:08:24 [auto1.fr] INFO: Saving data for FF55023: {'created_time': 1764954504.047682, 'last_price_update_time': 1764954504.047691, 'auction_closing_time': 1765036911.0}
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FF55023') HTTP/1.1" 204 0
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df75d0>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_250e5faede9eae98c6ffd1b8620cb378.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg not downloaded yet
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea3dd0>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_c58da11633f79e2021a4776e25181644.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ae96d0>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg not downloaded yet
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP91429> (referer: https://www.auto1.com/v1/car-details-view/GP91429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg not downloaded yet
2025-12-05 17:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e5550>
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_d696db610464cabbc2ed7d3bbc5df610.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg saved to cache
2025-12-05 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_b187511563c2b6b727ed441528f3b8ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg not downloaded yet
2025-12-05 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93862da8-4f46-5ac2-92a8-258b6aeeba17 with identifier: GP91429
2025-12-05 17:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93862da8-4f46-5ac2-92a8-258b6aeeba17 with scrape type 2
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93862da8-4f46-5ac2-92a8-258b6aeeba17 with scrape type 2
2025-12-05 17:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93862da8-4f46-5ac2-92a8-258b6aeeba17, identifier: GP91429
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7a910>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_c768f5bc7635bc561e5701bb07796980.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg saved to cache
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c61790>
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_8e80c30ffa759711f9e757125504480a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg saved to cache
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_8d7999f8376863aadfc20f6d22c998f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg not downloaded yet
2025-12-05 17:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93862da8-4f46-5ac2-92a8-258b6aeeba17 with identifier: GP91429
2025-12-05 17:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93862da8-4f46-5ac2-92a8-258b6aeeba17 with identifier: GP91429
2025-12-05 17:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 93862da8-4f46-5ac2-92a8-258b6aeeba17 with identifier: GP91429 to the API
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP91429>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:50:47Z',
'fuel_type': 'diesel',
'id': '93862da8-4f46-5ac2-92a8-258b6aeeba17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP91429',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 143833,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2018}
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP91429%27 HTTP/1.1" 200 None
2025-12-05 17:08:25 [auto1.fr] INFO: Saving data for GP91429: {'auction_closing_time': 1765039847.0, 'created_time': 1761411912.222152, 'last_price_update_time': 1764954505.979077}
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP91429') HTTP/1.1" 204 0
2025-12-05 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_53f8cdee06e67590671eafaad33717d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg not downloaded yet
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU68927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD83766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591bc50>
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_bed3c3d9dc2592775a3d89cc43542778.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg saved to cache
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_e319afd07e4e9b643733c7a0efe5c576.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg not downloaded yet
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fd150>
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg saved to cache
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b26210>
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg saved to cache
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_40cc010aab19b27a4060cc72de7d25e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg not downloaded yet
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_aeb35f377d0149578334a461fdfdc3a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg not downloaded yet
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef6d10>
2025-12-05 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg saved to cache
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5740dd0>
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_8d7999f8376863aadfc20f6d22c998f8.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg saved to cache
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a82e50>
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_b187511563c2b6b727ed441528f3b8ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg saved to cache
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5844a90>
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_98ed796b74a5f802ab56c176c5238de1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg saved to cache
2025-12-05 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0a290>
2025-12-05 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg saved to cache
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59cb690>
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_53f8cdee06e67590671eafaad33717d5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg saved to cache
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb68d0>
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_e319afd07e4e9b643733c7a0efe5c576.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg saved to cache
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d94890>
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_40cc010aab19b27a4060cc72de7d25e4.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg saved to cache
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c83150>
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_aeb35f377d0149578334a461fdfdc3a2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg saved to cache
2025-12-05 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7b190>
2025-12-05 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg saved to cache
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf8150>
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fcb%252F8bcba361dcc39391d0ec02a7bc82f47f%252Fpa%252FUT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg saved to cache
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44
2025-12-05 17:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e68dd25-bfae-5870-8f15-281f5ec8bd44, skipping ID generation
2025-12-05 17:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44 with scrape type 1
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0e68dd25-bfae-5870-8f15-281f5ec8bd44 from tracking dictionaries
2025-12-05 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e68dd25-bfae-5870-8f15-281f5ec8bd44 sending to next pipeline
2025-12-05 17:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e68dd25-bfae-5870-8f15-281f5ec8bd44, identifier: UT27070
2025-12-05 17:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e68dd25-bfae-5870-8f15-281f5ec8bd44 with identifier: UT27070
2025-12-05 17:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e68dd25-bfae-5870-8f15-281f5ec8bd44 with identifier: UT27070
2025-12-05 17:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 21, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan qashqai 1.2 n-connecta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'manual', 'odometer': 114151, 'odometer_reading_unit': 'km', 'registration_date': '2016-11-09', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut27070', 'expiration_date': '2025-12-06t16:52:53z', 'origin_country_code': 'fr', 'trim': 'n-connecta', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, manhac', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': '0e68dd25-bfae-5870-8f15-281f5ec8bd44', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75790}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74063}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72052}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78634}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77646}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73650}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92392}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70430}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 118049}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90104}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90710}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 118297}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 18483}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20950}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 19997}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 19244}], 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 114151}
Failed validating None in schema:
False
On instance:
{'age_in_months': 108,
'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 115,
'expiration_date': '2025-12-06t16:52:53z',
'fuel_type': 'petrol',
'id': '0e68dd25-bfae-5870-8f15-281f5ec8bd44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut27070',
'listing': 'auction',
'location': 'fr, manhac',
'make': 'nissan',
'make_model': 'nissan qashqai',
'model': 'qashqai',
'odometer': 114151,
'odometer_in_km': 114151,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-11-09',
'sanitized_make': 'nissan',
'seats_number': 5,
'seller_name': None,
'title': 'nissan qashqai 1.2 n-connecta',
'transmission': 'manual',
'trim': 'n-connecta',
'year': 2016}
2025-12-05 17:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0e68dd25-bfae-5870-8f15-281f5ec8bd44 spider: auto1.fr
2025-12-05 17:08:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0e68dd25-bfae-5870-8f15-281f5ec8bd44 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 21, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan qashqai 1.2 n-connecta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'manual', 'odometer': 114151, 'odometer_reading_unit': 'km', 'registration_date': '2016-11-09', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut27070', 'expiration_date': '2025-12-06t16:52:53z', 'origin_country_code': 'fr', 'trim': 'n-connecta', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, manhac', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': '0e68dd25-bfae-5870-8f15-281f5ec8bd44', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75790}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74063}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72052}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78634}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77646}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73650}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92392}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70430}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 118049}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90104}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90710}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 118297}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 18483}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20950}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 19997}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_19.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 19244}], 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 114151}
Failed validating None in schema:
False
On instance:
{'age_in_months': 108,
'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 115,
'expiration_date': '2025-12-06t16:52:53z',
'fuel_type': 'petrol',
'id': '0e68dd25-bfae-5870-8f15-281f5ec8bd44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut27070',
'listing': 'auction',
'location': 'fr, manhac',
'make': 'nissan',
'make_model': 'nissan qashqai',
'model': 'qashqai',
'odometer': 114151,
'odometer_in_km': 114151,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-11-09',
'sanitized_make': 'nissan',
'seats_number': 5,
'seller_name': None,
'title': 'nissan qashqai 1.2 n-connecta',
'transmission': 'manual',
'trim': 'n-connecta',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:52:53Z',
'fuel_type': 'petrol',
'id': '0e68dd25-bfae-5870-8f15-281f5ec8bd44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT27070',
'listing': 'auction',
'location': 'FR, Manhac',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 114151,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_250e5faede9eae98c6ffd1b8620cb378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c58da11633f79e2021a4776e25181644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_27b4c742cbe7ad2a6be57e4de5460ca2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_00bef1a0ac097b3b3219c4b17bffe7d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_a08f0157a9237d1cce63aa2dd35189f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_98ed796b74a5f802ab56c176c5238de1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8082d66b6376d0e8c17bb37ec202ad41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_d696db610464cabbc2ed7d3bbc5df610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_c768f5bc7635bc561e5701bb07796980.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8e80c30ffa759711f9e757125504480a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_bed3c3d9dc2592775a3d89cc43542778.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_75b74ff6d3e3434ce5c114f6356a68dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e4e2f56604c5f7029bc90605cff34ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_3210fb1afdae2eda7fcd2e16dd46e7ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_b187511563c2b6b727ed441528f3b8ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_8d7999f8376863aadfc20f6d22c998f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_53f8cdee06e67590671eafaad33717d5.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_e319afd07e4e9b643733c7a0efe5c576.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_40cc010aab19b27a4060cc72de7d25e4.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e68dd25-bfae-5870-8f15-281f5ec8bd44/0e68dd25-bfae-5870-8f15-281f5ec8bd44_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/cb/8bcba361dcc39391d0ec02a7bc82f47f/pa/UT27070_aeb35f377d0149578334a461fdfdc3a2.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.2 N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2016}
2025-12-05 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT27070%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [auto1.fr] INFO: Saving data for UT27070: {'created_time': 1764954510.008521, 'last_price_update_time': 1764954510.008531, 'auction_closing_time': 1765039973.0}
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT27070') HTTP/1.1" 204 0
2025-12-05 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN65499> (referer: https://www.auto1.com/v1/car-details-view/EN65499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 with identifier: EN65499
2025-12-05 17:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 with scrape type 2
2025-12-05 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 with scrape type 2
2025-12-05 17:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2, identifier: EN65499
2025-12-05 17:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 with identifier: EN65499
2025-12-05 17:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 with identifier: EN65499
2025-12-05 17:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2025-12-05 17:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 spider: auto1.fr
2025-12-05 17:08:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0f7e39fb-ef10-59b6-b0d2-0b2c228263f2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:31:50Z',
'fuel_type': 'diesel',
'id': '0f7e39fb-ef10-59b6-b0d2-0b2c228263f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN65499',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 29640,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-03',
'seats_number': 9,
'seller_name': None,
'title': 'Peugeot Boxer 2.0 Blue-HDi 330 L1H1 Active Blue-HDi 110',
'transmission': 'manual',
'trim': '330 L1H1 Active Blue-HDi 110',
'year': 2017}
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN65499%27 HTTP/1.1" 200 None
2025-12-05 17:08:30 [auto1.fr] INFO: Saving data for EN65499: {'auction_closing_time': 1765038710.0, 'created_time': 1764669865.736308, 'last_price_update_time': 1764954510.416811}
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EN65499') HTTP/1.1" 204 0
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU43983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU21590> (referer: https://www.auto1.com/v1/car-details-view/CU21590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR31605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT74756> (referer: https://www.auto1.com/v1/car-details-view/YT74756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c87f45c7-94a0-553d-b904-af8b82817dde with identifier: CU21590
2025-12-05 17:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c87f45c7-94a0-553d-b904-af8b82817dde with scrape type 1
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg not downloaded yet
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_f9882ce83c94ef7649e617ff9c9b4314.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f9882ce83c94ef7649e617ff9c9b4314.jpg not downloaded yet
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_54fe8d83090e28aa8de69eb191d1def6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_54fe8d83090e28aa8de69eb191d1def6.jpg not downloaded yet
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_cc70c7e85a4ca7120b9b7ab3b7deac4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_cc70c7e85a4ca7120b9b7ab3b7deac4c.jpg not downloaded yet
2025-12-05 17:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31 with identifier: YT74756
2025-12-05 17:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31 with scrape type 2
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31 with scrape type 2
2025-12-05 17:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31, identifier: YT74756
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_b11da0045faf2a02388a816e1263ba82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b11da0045faf2a02388a816e1263ba82.jpg not downloaded yet
2025-12-05 17:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31 with identifier: YT74756
2025-12-05 17:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31 with identifier: YT74756
2025-12-05 17:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31 with identifier: YT74756 to the API
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT74756>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:25:37Z',
'fuel_type': 'petrol',
'id': 'afd3fbfa-35e4-5fc7-9c3a-1b3fbd94ea31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT74756',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 17457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-15',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Edizione Speciale',
'transmission': 'automatic',
'trim': 'Edizione Speciale',
'year': 2022}
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT74756%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [auto1.fr] INFO: Saving data for YT74756: {'auction_closing_time': 1765038337.0, 'created_time': 1764004973.673022, 'last_price_update_time': 1764954512.043491}
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT74756') HTTP/1.1" 204 0
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_a9e9d388d53d8094f50496cacc405ae5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_a9e9d388d53d8094f50496cacc405ae5.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_9b5b8941d75a688e25c41e7fbe544477.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_9b5b8941d75a688e25c41e7fbe544477.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_b54ffd49b0157b004735618e7987a1f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b54ffd49b0157b004735618e7987a1f7.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_f8e587229a6f54b2392ef84b9a9465e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f8e587229a6f54b2392ef84b9a9465e8.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_05d798a7b20039a6e11c7063b53332f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_05d798a7b20039a6e11c7063b53332f8.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_7b9772b8f152476cb6cbd8f72e2a9793.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_7b9772b8f152476cb6cbd8f72e2a9793.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_4030c838bc78d52a66eee08bb588c884.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_4030c838bc78d52a66eee08bb588c884.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_6505f0402cd323619770f534eace3627.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_6505f0402cd323619770f534eace3627.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_92e7f4571db42e1bdf987508ca277e8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_92e7f4571db42e1bdf987508ca277e8d.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_fd3d3fa0705a1120eb35f9ea42907602.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_fd3d3fa0705a1120eb35f9ea42907602.jpg not downloaded yet
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_14dd9e4fd466c5384c2544157bcf0d54.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_14dd9e4fd466c5384c2544157bcf0d54.jpg not downloaded yet
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX73985> (referer: https://www.auto1.com/v1/car-details-view/BX73985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_14dd9e4fd466c5384c2544157bcf0d54.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec52b0b9-c5d9-56c9-92d8-69a6fa656c16 with identifier: BX73985
2025-12-05 17:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec52b0b9-c5d9-56c9-92d8-69a6fa656c16 with scrape type 2
2025-12-05 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec52b0b9-c5d9-56c9-92d8-69a6fa656c16 with scrape type 2
2025-12-05 17:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec52b0b9-c5d9-56c9-92d8-69a6fa656c16, identifier: BX73985
2025-12-05 17:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec52b0b9-c5d9-56c9-92d8-69a6fa656c16 with identifier: BX73985
2025-12-05 17:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec52b0b9-c5d9-56c9-92d8-69a6fa656c16 with identifier: BX73985
2025-12-05 17:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec52b0b9-c5d9-56c9-92d8-69a6fa656c16 with identifier: BX73985 to the API
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX73985>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:52:53Z',
'fuel_type': 'diesel',
'id': 'ec52b0b9-c5d9-56c9-92d8-69a6fa656c16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX73985',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 44660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.5 CDTI GS Line',
'transmission': 'automatic',
'trim': 'GS Line',
'year': 2021}
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX73985%27 HTTP/1.1" 200 None
2025-12-05 17:08:33 [auto1.fr] INFO: Saving data for BX73985: {'auction_closing_time': 1765039973.0, 'created_time': 1764756117.934178, 'last_price_update_time': 1764954513.759034}
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BX73985') HTTP/1.1" 204 0
2025-12-05 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_fd3d3fa0705a1120eb35f9ea42907602.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5780a50>
2025-12-05 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_14dd9e4fd466c5384c2544157bcf0d54.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_14dd9e4fd466c5384c2544157bcf0d54.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c78c7e90>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_fd3d3fa0705a1120eb35f9ea42907602.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_fd3d3fa0705a1120eb35f9ea42907602.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_92e7f4571db42e1bdf987508ca277e8d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM17009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578a550>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_92e7f4571db42e1bdf987508ca277e8d.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_92e7f4571db42e1bdf987508ca277e8d.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_4030c838bc78d52a66eee08bb588c884.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_6505f0402cd323619770f534eace3627.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c50350>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_4030c838bc78d52a66eee08bb588c884.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_4030c838bc78d52a66eee08bb588c884.jpg saved to cache
2025-12-05 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e81b50>
2025-12-05 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_6505f0402cd323619770f534eace3627.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_6505f0402cd323619770f534eace3627.jpg saved to cache
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_7b9772b8f152476cb6cbd8f72e2a9793.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_05d798a7b20039a6e11c7063b53332f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0c5d0>
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_7b9772b8f152476cb6cbd8f72e2a9793.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_7b9772b8f152476cb6cbd8f72e2a9793.jpg saved to cache
2025-12-05 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0a450>
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_05d798a7b20039a6e11c7063b53332f8.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_05d798a7b20039a6e11c7063b53332f8.jpg saved to cache
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f8e587229a6f54b2392ef84b9a9465e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d6d890>
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_f8e587229a6f54b2392ef84b9a9465e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f8e587229a6f54b2392ef84b9a9465e8.jpg saved to cache
2025-12-05 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b54ffd49b0157b004735618e7987a1f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5776710>
2025-12-05 17:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_b54ffd49b0157b004735618e7987a1f7.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b54ffd49b0157b004735618e7987a1f7.jpg saved to cache
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU68927> (referer: https://www.auto1.com/v1/car-details-view/WU68927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_9b5b8941d75a688e25c41e7fbe544477.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_a9e9d388d53d8094f50496cacc405ae5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b11da0045faf2a02388a816e1263ba82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 with identifier: WU68927
2025-12-05 17:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 with scrape type 2
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 with scrape type 2
2025-12-05 17:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a654796a-39c6-5ab1-9e18-df7a7ef4d1b5, identifier: WU68927
2025-12-05 17:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 with identifier: WU68927
2025-12-05 17:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 with identifier: WU68927
2025-12-05 17:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174624 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174624
2025-12-05 17:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 spider: auto1.fr
2025-12-05 17:08:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a654796a-39c6-5ab1-9e18-df7a7ef4d1b5 due to rule: high_mileage_for_country.json, error: 174624 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174624
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:05:34Z',
'fuel_type': 'diesel',
'id': 'a654796a-39c6-5ab1-9e18-df7a7ef4d1b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU68927',
'listing': 'auction',
'location': 'La Garde',
'make': 'Opel',
'model': 'Astra',
'odometer': 174624,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Innovation Start/Stop',
'transmission': 'manual',
'trim': 'Innovation Start/Stop',
'year': 2017}
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU68927%27 HTTP/1.1" 200 None
2025-12-05 17:08:37 [auto1.fr] INFO: Saving data for WU68927: {'auction_closing_time': 1765037134.0, 'created_time': 1764262938.491373, 'last_price_update_time': 1764954517.606671}
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU68927') HTTP/1.1" 204 0
2025-12-05 17:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c9b190>
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_9b5b8941d75a688e25c41e7fbe544477.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_9b5b8941d75a688e25c41e7fbe544477.jpg saved to cache
2025-12-05 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb1710>
2025-12-05 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_a9e9d388d53d8094f50496cacc405ae5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_a9e9d388d53d8094f50496cacc405ae5.jpg saved to cache
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58de190>
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_b11da0045faf2a02388a816e1263ba82.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b11da0045faf2a02388a816e1263ba82.jpg saved to cache
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU26238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_cc70c7e85a4ca7120b9b7ab3b7deac4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c53190>
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_cc70c7e85a4ca7120b9b7ab3b7deac4c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_cc70c7e85a4ca7120b9b7ab3b7deac4c.jpg saved to cache
2025-12-05 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW38104> (referer: https://www.auto1.com/v1/car-details-view/SW38104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD83766> (referer: https://www.auto1.com/v1/car-details-view/LD83766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_54fe8d83090e28aa8de69eb191d1def6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f9882ce83c94ef7649e617ff9c9b4314.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46e44cf-40b8-5e60-8276-7be30c823331 with identifier: SW38104
2025-12-05 17:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46e44cf-40b8-5e60-8276-7be30c823331 with scrape type 1
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a46e44cf-40b8-5e60-8276-7be30c823331
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_4b86ef1166401cffc3dca038e91757e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_4b86ef1166401cffc3dca038e91757e5.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_af3cd766ea960f0dd5f9056397fb4194.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_af3cd766ea960f0dd5f9056397fb4194.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_e03f31ecfd879183fa5a66a213fe2e61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_e03f31ecfd879183fa5a66a213fe2e61.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_268f7c42e068f07721becde8cafa7319.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_268f7c42e068f07721becde8cafa7319.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_5114c061036687b4d5fe1299807a949a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_5114c061036687b4d5fe1299807a949a.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_1774cba02f6cfab09f5929ed211b6ea5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_1774cba02f6cfab09f5929ed211b6ea5.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_831c44559e540a5e28330fcfa6d4cd40.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_831c44559e540a5e28330fcfa6d4cd40.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_d5088f429dce74555a1c6a539eaf2687.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_d5088f429dce74555a1c6a539eaf2687.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_44fc038f1ac41b2d17ba49ff62d9e393.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_44fc038f1ac41b2d17ba49ff62d9e393.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_581fa91211199ef46d63f0459a08fee8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_581fa91211199ef46d63f0459a08fee8.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_e879b7421884a8c6fa25945c2dfd3f43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_e879b7421884a8c6fa25945c2dfd3f43.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_5035d995daa13e887fe0c24bd64fbaf0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_5035d995daa13e887fe0c24bd64fbaf0.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_16cc0d3ac5900520c7567e608dc239b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_16cc0d3ac5900520c7567e608dc239b5.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_ef7afa9298420807430308899065bec8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_ef7afa9298420807430308899065bec8.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_02613f343ccf0d21f97d1164d7d7d1c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_02613f343ccf0d21f97d1164d7d7d1c0.jpg already downloaded
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fc3%252F7ec38af65ea727df6deea3428af7d2ea%252Fpa%252FSW38104_db853fb94951d452eddf21aefbf83269.png%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_db853fb94951d452eddf21aefbf83269.png already downloaded
2025-12-05 17:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a46e44cf-40b8-5e60-8276-7be30c823331, identifier: SW38104
2025-12-05 17:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5168c12-30e3-50c3-9cb1-e4d586c0ae5d with identifier: LD83766
2025-12-05 17:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d with scrape type 1
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_3566f08150a5862846823a13264dd441.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3566f08150a5862846823a13264dd441.jpg not downloaded yet
2025-12-05 17:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a46e44cf-40b8-5e60-8276-7be30c823331 with identifier: SW38104
2025-12-05 17:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a46e44cf-40b8-5e60-8276-7be30c823331 with identifier: SW38104
2025-12-05 17:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a46e44cf-40b8-5e60-8276-7be30c823331 with identifier: SW38104 to the API
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW38104>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:32:03Z',
'fuel_type': 'diesel',
'id': 'a46e44cf-40b8-5e60-8276-7be30c823331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW38104',
'listing': 'auction',
'location': 'FR, Anais',
'make': 'Renault',
'model': 'Megane',
'odometer': 106937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_4b86ef1166401cffc3dca038e91757e5.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_af3cd766ea960f0dd5f9056397fb4194.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_e03f31ecfd879183fa5a66a213fe2e61.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_268f7c42e068f07721becde8cafa7319.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_5114c061036687b4d5fe1299807a949a.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_1774cba02f6cfab09f5929ed211b6ea5.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_831c44559e540a5e28330fcfa6d4cd40.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_d5088f429dce74555a1c6a539eaf2687.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_44fc038f1ac41b2d17ba49ff62d9e393.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_581fa91211199ef46d63f0459a08fee8.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_e879b7421884a8c6fa25945c2dfd3f43.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_5035d995daa13e887fe0c24bd64fbaf0.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_16cc0d3ac5900520c7567e608dc239b5.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_ef7afa9298420807430308899065bec8.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_02613f343ccf0d21f97d1164d7d7d1c0.jpg',
'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_db853fb94951d452eddf21aefbf83269.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_4b86ef1166401cffc3dca038e91757e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_af3cd766ea960f0dd5f9056397fb4194.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_e03f31ecfd879183fa5a66a213fe2e61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_268f7c42e068f07721becde8cafa7319.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_5114c061036687b4d5fe1299807a949a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_1774cba02f6cfab09f5929ed211b6ea5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_831c44559e540a5e28330fcfa6d4cd40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_d5088f429dce74555a1c6a539eaf2687.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_44fc038f1ac41b2d17ba49ff62d9e393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_581fa91211199ef46d63f0459a08fee8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_e879b7421884a8c6fa25945c2dfd3f43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_5035d995daa13e887fe0c24bd64fbaf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_16cc0d3ac5900520c7567e608dc239b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_ef7afa9298420807430308899065bec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_02613f343ccf0d21f97d1164d7d7d1c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46e44cf-40b8-5e60-8276-7be30c823331/a46e44cf-40b8-5e60-8276-7be30c823331_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 69335,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img7e/c3/7ec38af65ea727df6deea3428af7d2ea/pa/SW38104_db853fb94951d452eddf21aefbf83269.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi Techno',
'transmission': 'manual',
'trim': 'Techno',
'year': 2022}
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW38104%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [auto1.fr] INFO: Saving data for SW38104: {'created_time': 1764954519.896199, 'last_price_update_time': 1764954519.896212, 'auction_closing_time': 1765038723.0}
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW38104') HTTP/1.1" 204 0
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_c1f96d911330ea008599dc343666fdac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_c1f96d911330ea008599dc343666fdac.jpg not downloaded yet
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_28c209961e712f238db83329788b53c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_28c209961e712f238db83329788b53c5.jpg not downloaded yet
2025-12-05 17:08:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57c0f50>
2025-12-05 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_54fe8d83090e28aa8de69eb191d1def6.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_54fe8d83090e28aa8de69eb191d1def6.jpg saved to cache
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ffa90>
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_f9882ce83c94ef7649e617ff9c9b4314.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f9882ce83c94ef7649e617ff9c9b4314.jpg saved to cache
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_819a23dd6fb4ec08673191ecd79185be.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_819a23dd6fb4ec08673191ecd79185be.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_aca8ec76463331a7f28622ce04f8b1e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_aca8ec76463331a7f28622ce04f8b1e2.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_7acafd396edb08f23bd60628fa699712.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_7acafd396edb08f23bd60628fa699712.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_d1eb0c0755c809eff1fa56ea950b286c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_d1eb0c0755c809eff1fa56ea950b286c.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_6494a9f65625b52ea733e6fabb11767c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_6494a9f65625b52ea733e6fabb11767c.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_fc4a04791fe991f5459e317429a95d83.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_fc4a04791fe991f5459e317429a95d83.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_3ceecb66f43e31b5b2eade93309da1f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3ceecb66f43e31b5b2eade93309da1f2.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_b5673c0acecfbd55ce4850e5ef483b92.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_b5673c0acecfbd55ce4850e5ef483b92.jpg not downloaded yet
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_819a23dd6fb4ec08673191ecd79185be.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_ee0b333fce48ce09a935c6cc4c4909eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_ee0b333fce48ce09a935c6cc4c4909eb.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_40d01716410b49cc4f941eea799b8f73.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_40d01716410b49cc4f941eea799b8f73.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_8e045c0e8c9f8827cca7f042b5f79dbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_8e045c0e8c9f8827cca7f042b5f79dbe.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_f9ed6c7b1b8b30ff5d52bff57db185d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_f9ed6c7b1b8b30ff5d52bff57db185d9.jpg not downloaded yet
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_e69f6c4b4d0bebb8e3861c8672d90390.png%27 HTTP/1.1" 200 None
2025-12-05 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_e69f6c4b4d0bebb8e3861c8672d90390.png not downloaded yet
2025-12-05 17:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c83ad0>
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_819a23dd6fb4ec08673191ecd79185be.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_819a23dd6fb4ec08673191ecd79185be.jpg saved to cache
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9d210>
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F2e%252F5c2e9075f55dfaa7ace1b2ba7acce71e%252Fpa%252FCU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg saved to cache
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c87f45c7-94a0-553d-b904-af8b82817dde
2025-12-05 17:08:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c87f45c7-94a0-553d-b904-af8b82817dde, skipping ID generation
2025-12-05 17:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c87f45c7-94a0-553d-b904-af8b82817dde with scrape type 1
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c87f45c7-94a0-553d-b904-af8b82817dde from tracking dictionaries
2025-12-05 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c87f45c7-94a0-553d-b904-af8b82817dde sending to next pipeline
2025-12-05 17:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c87f45c7-94a0-553d-b904-af8b82817dde, identifier: CU21590
2025-12-05 17:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c87f45c7-94a0-553d-b904-af8b82817dde with identifier: CU21590
2025-12-05 17:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c87f45c7-94a0-553d-b904-af8b82817dde with identifier: CU21590
2025-12-05 17:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c87f45c7-94a0-553d-b904-af8b82817dde with identifier: CU21590 to the API
2025-12-05 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:17:43Z',
'fuel_type': 'diesel',
'id': 'c87f45c7-94a0-553d-b904-af8b82817dde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU21590',
'listing': 'auction',
'location': 'FR, Fresnes',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 31645,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3187424,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_2293939fe2b1373d0d35f7ea9926edc0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3119542,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f9882ce83c94ef7649e617ff9c9b4314.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3208898,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_54fe8d83090e28aa8de69eb191d1def6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2964204,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_cc70c7e85a4ca7120b9b7ab3b7deac4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b11da0045faf2a02388a816e1263ba82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_a9e9d388d53d8094f50496cacc405ae5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2990977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_9b5b8941d75a688e25c41e7fbe544477.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3133995,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_b54ffd49b0157b004735618e7987a1f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3208402,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_f8e587229a6f54b2392ef84b9a9465e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3132117,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_05d798a7b20039a6e11c7063b53332f8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2786466,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_7b9772b8f152476cb6cbd8f72e2a9793.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_4030c838bc78d52a66eee08bb588c884.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_6505f0402cd323619770f534eace3627.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_92e7f4571db42e1bdf987508ca277e8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_fd3d3fa0705a1120eb35f9ea42907602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c87f45c7-94a0-553d-b904-af8b82817dde/c87f45c7-94a0-553d-b904-af8b82817dde_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/2e/5c2e9075f55dfaa7ace1b2ba7acce71e/pa/CU21590_14dd9e4fd466c5384c2544157bcf0d54.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-21',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU21590%27 HTTP/1.1" 200 None
2025-12-05 17:08:42 [auto1.fr] INFO: Saving data for CU21590: {'created_time': 1764954522.109891, 'last_price_update_time': 1764954522.1099, 'auction_closing_time': 1765037863.0}
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU21590') HTTP/1.1" 204 0
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_e69f6c4b4d0bebb8e3861c8672d90390.png> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_b5673c0acecfbd55ce4850e5ef483b92.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_8e045c0e8c9f8827cca7f042b5f79dbe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:08:42 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:08:42 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:08:42 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c83450>
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_15.png HTTP/1.1" 201 0
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_e69f6c4b4d0bebb8e3861c8672d90390.png') HTTP/1.1" 204 0
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_e69f6c4b4d0bebb8e3861c8672d90390.png saved to cache
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_40d01716410b49cc4f941eea799b8f73.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_f9ed6c7b1b8b30ff5d52bff57db185d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a96990>
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_b5673c0acecfbd55ce4850e5ef483b92.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_b5673c0acecfbd55ce4850e5ef483b92.jpg saved to cache
2025-12-05 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cba210>
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_8e045c0e8c9f8827cca7f042b5f79dbe.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_8e045c0e8c9f8827cca7f042b5f79dbe.jpg saved to cache
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_ee0b333fce48ce09a935c6cc4c4909eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dc7250>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_40d01716410b49cc4f941eea799b8f73.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_40d01716410b49cc4f941eea799b8f73.jpg saved to cache
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7c12210>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_f9ed6c7b1b8b30ff5d52bff57db185d9.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_f9ed6c7b1b8b30ff5d52bff57db185d9.jpg saved to cache
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_fc4a04791fe991f5459e317429a95d83.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3ceecb66f43e31b5b2eade93309da1f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb4910>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_ee0b333fce48ce09a935c6cc4c4909eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_ee0b333fce48ce09a935c6cc4c4909eb.jpg saved to cache
2025-12-05 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_6494a9f65625b52ea733e6fabb11767c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e75310>
2025-12-05 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_fc4a04791fe991f5459e317429a95d83.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_fc4a04791fe991f5459e317429a95d83.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f14110>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_3ceecb66f43e31b5b2eade93309da1f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3ceecb66f43e31b5b2eade93309da1f2.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_d1eb0c0755c809eff1fa56ea950b286c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5891990>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_6494a9f65625b52ea733e6fabb11767c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_6494a9f65625b52ea733e6fabb11767c.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_7acafd396edb08f23bd60628fa699712.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_aca8ec76463331a7f28622ce04f8b1e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d65150>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_d1eb0c0755c809eff1fa56ea950b286c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_d1eb0c0755c809eff1fa56ea950b286c.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_c1f96d911330ea008599dc343666fdac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_28c209961e712f238db83329788b53c5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea3990>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_7acafd396edb08f23bd60628fa699712.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_7acafd396edb08f23bd60628fa699712.jpg saved to cache
2025-12-05 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d6cfd0>
2025-12-05 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_aca8ec76463331a7f28622ce04f8b1e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_aca8ec76463331a7f28622ce04f8b1e2.jpg saved to cache
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cbe6d0>
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_c1f96d911330ea008599dc343666fdac.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_c1f96d911330ea008599dc343666fdac.jpg saved to cache
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57d4990>
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_28c209961e712f238db83329788b53c5.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_28c209961e712f238db83329788b53c5.jpg saved to cache
2025-12-05 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3566f08150a5862846823a13264dd441.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a736d0>
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fe5%252F8fe54e83b44cad3356ae17c5a7715719%252Fpa%252FLD83766_3566f08150a5862846823a13264dd441.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3566f08150a5862846823a13264dd441.jpg saved to cache
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d
2025-12-05 17:08:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5168c12-30e3-50c3-9cb1-e4d586c0ae5d, skipping ID generation
2025-12-05 17:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d with scrape type 1
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d from tracking dictionaries
2025-12-05 17:08:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5168c12-30e3-50c3-9cb1-e4d586c0ae5d sending to next pipeline
2025-12-05 17:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5168c12-30e3-50c3-9cb1-e4d586c0ae5d, identifier: LD83766
2025-12-05 17:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5168c12-30e3-50c3-9cb1-e4d586c0ae5d with identifier: LD83766
2025-12-05 17:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5168c12-30e3-50c3-9cb1-e4d586c0ae5d with identifier: LD83766
2025-12-05 17:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5168c12-30e3-50c3-9cb1-e4d586c0ae5d with identifier: LD83766 to the API
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3566f08150a5862846823a13264dd441.jpg>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:21:06Z',
'fuel_type': 'petrol',
'id': 'c5168c12-30e3-50c3-9cb1-e4d586c0ae5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD83766',
'listing': 'auction',
'location': 'FR, Saint-Maur-des-Fossés',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 148275,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2304877,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3566f08150a5862846823a13264dd441.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_c1f96d911330ea008599dc343666fdac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_28c209961e712f238db83329788b53c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_819a23dd6fb4ec08673191ecd79185be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_aca8ec76463331a7f28622ce04f8b1e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_7acafd396edb08f23bd60628fa699712.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_d1eb0c0755c809eff1fa56ea950b286c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_6494a9f65625b52ea733e6fabb11767c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_fc4a04791fe991f5459e317429a95d83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_3ceecb66f43e31b5b2eade93309da1f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2482079,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_b5673c0acecfbd55ce4850e5ef483b92.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_ee0b333fce48ce09a935c6cc4c4909eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_40d01716410b49cc4f941eea799b8f73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_8e045c0e8c9f8827cca7f042b5f79dbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_f9ed6c7b1b8b30ff5d52bff57db185d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5168c12-30e3-50c3-9cb1-e4d586c0ae5d/c5168c12-30e3-50c3-9cb1-e4d586c0ae5d_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 89012,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img8f/e5/8fe54e83b44cad3356ae17c5a7715719/pa/LD83766_e69f6c4b4d0bebb8e3861c8672d90390.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-09',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TSI Carat Exclusive 4Motion',
'transmission': 'automatic',
'trim': 'Carat Exclusive 4Motion',
'year': 2019}
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD83766%27 HTTP/1.1" 200 None
2025-12-05 17:08:46 [auto1.fr] INFO: Saving data for LD83766: {'created_time': 1764954526.876379, 'last_price_update_time': 1764954526.87639, 'auction_closing_time': 1765038066.0}
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LD83766') HTTP/1.1" 204 0
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD98246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV05125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE58838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM17009> (referer: https://www.auto1.com/v1/car-details-view/BM17009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d with identifier: BM17009
2025-12-05 17:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d with scrape type 1
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_eda979de9cdf999b2509ae3d9456ff98.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_9b853d797c1efe66c22665403b89dec9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_9446026ee6d759817476a1552773c7a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_64813e94755ebaf72eeb912acae7958b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_bf1d9971559ce320443f70d38258c28b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_023ca726b11a95d4ba0b77d0213862d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_0b8ea98219db593774d81f4a06745ae3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_835133cecf737d63220e12bae8ad3b13.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg already downloaded
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg already downloaded
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_a5a02b9d652beebe590905404e3d5aa8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg already downloaded
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg already downloaded
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_861fb3f766a695fdc744de8fbad19afc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg already downloaded
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg already downloaded
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F03%252F0903edc3d0f4c3b17238b4d0111dae39%252Fpa%252FBM17009_e23b519c24502299e755551120a6679f.png%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png already downloaded
2025-12-05 17:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d, identifier: BM17009
2025-12-05 17:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d with identifier: BM17009
2025-12-05 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d with identifier: BM17009
2025-12-05 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 62471, 'odometer_reading_unit': 'km', 'registration_date': '2016-07-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bm17009', 'expiration_date': '2025-12-06t16:23:36z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58492}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65574}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49290}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53124}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59259}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58274}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70379}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43981}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 97038}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 79144}], 'current_year_diff': 9, 'age_in_months': 112, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 62471}
Failed validating None in schema:
False
On instance:
{'age_in_months': 112,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:36z',
'fuel_type': 'petrol',
'id': '61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bm17009',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 62471,
'odometer_in_km': 62471,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 79144,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-24',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 e-thp gt line',
'transmission': 'automatic',
'trim': 'gt line',
'year': 2016}
2025-12-05 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d spider: auto1.fr
2025-12-05 17:08:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 62471, 'odometer_reading_unit': 'km', 'registration_date': '2016-07-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bm17009', 'expiration_date': '2025-12-06t16:23:36z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg', 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58492}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65574}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49290}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53124}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59259}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58274}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70379}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43981}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 97038}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 79144}], 'current_year_diff': 9, 'age_in_months': 112, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 62471}
Failed validating None in schema:
False
On instance:
{'age_in_months': 112,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:23:36z',
'fuel_type': 'petrol',
'id': '61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bm17009',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 62471,
'odometer_in_km': 62471,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 79144,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-24',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 e-thp gt line',
'transmission': 'automatic',
'trim': 'gt line',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:23:36Z',
'fuel_type': 'petrol',
'id': '61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM17009',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': '2008',
'odometer': 62471,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg',
'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_eda979de9cdf999b2509ae3d9456ff98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9b853d797c1efe66c22665403b89dec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_9446026ee6d759817476a1552773c7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_64813e94755ebaf72eeb912acae7958b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_16e01fa45cfe235c3fd510b84d5dfa22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_bf1d9971559ce320443f70d38258c28b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_023ca726b11a95d4ba0b77d0213862d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_0b8ea98219db593774d81f4a06745ae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_087ded5d0fc5c49ee73a0ecf853d0bc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_835133cecf737d63220e12bae8ad3b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_7241dcdd7755d1f29c990b9a439ca04b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_a5a02b9d652beebe590905404e3d5aa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_ac67699ab1ce230138b5f0e66d7e71f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_861fb3f766a695fdc744de8fbad19afc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_622582f1a6eb684ef53ade2e9d7502f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d/61f79753-a6a5-5a9f-9b3a-4f66a8e0d66d_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 79144,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img09/03/0903edc3d0f4c3b17238b4d0111dae39/pa/BM17009_e23b519c24502299e755551120a6679f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2016}
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM17009%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [auto1.fr] INFO: Saving data for BM17009: {'created_time': 1764954530.43697, 'last_price_update_time': 1764954530.436979, 'auction_closing_time': 1765038216.0}
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM17009') HTTP/1.1" 204 0
2025-12-05 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU35466> (referer: https://www.auto1.com/v1/car-details-view/JU35466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca50dd70-1390-5010-82bb-4b8bd6a5700a with identifier: JU35466
2025-12-05 17:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca50dd70-1390-5010-82bb-4b8bd6a5700a with scrape type 2
2025-12-05 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca50dd70-1390-5010-82bb-4b8bd6a5700a with scrape type 2
2025-12-05 17:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca50dd70-1390-5010-82bb-4b8bd6a5700a, identifier: JU35466
2025-12-05 17:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca50dd70-1390-5010-82bb-4b8bd6a5700a with identifier: JU35466
2025-12-05 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca50dd70-1390-5010-82bb-4b8bd6a5700a with identifier: JU35466
2025-12-05 17:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca50dd70-1390-5010-82bb-4b8bd6a5700a with identifier: JU35466 to the API
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU35466>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:36:33Z',
'fuel_type': 'diesel',
'id': 'ca50dd70-1390-5010-82bb-4b8bd6a5700a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU35466',
'listing': 'auction',
'location': 'FR',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 88688,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Life Business 1st',
'transmission': 'manual',
'trim': 'Life Business 1st',
'year': 2020}
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU35466%27 HTTP/1.1" 200 None
2025-12-05 17:08:50 [auto1.fr] INFO: Saving data for JU35466: {'auction_closing_time': 1765038993.0, 'created_time': 1764608601.101594, 'last_price_update_time': 1764954530.972579}
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU35466') HTTP/1.1" 204 0
2025-12-05 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR31605> (referer: https://www.auto1.com/v1/car-details-view/TR31605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54d7462-87f6-5279-aca1-f66bb557c40c with identifier: TR31605
2025-12-05 17:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54d7462-87f6-5279-aca1-f66bb557c40c with scrape type 1
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_7806e7fb2e7218fa06d8cacbc1cc4bde.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7806e7fb2e7218fa06d8cacbc1cc4bde.jpg not downloaded yet
2025-12-05 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_45acd8b51a649f31db0850c2bdd1486a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_45acd8b51a649f31db0850c2bdd1486a.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_c251aad858bf13f02f165e5e7e441d12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_c251aad858bf13f02f165e5e7e441d12.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_6e73c1bdf5447cd2a643e15f9624c3af.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_6e73c1bdf5447cd2a643e15f9624c3af.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_9d0cda1318af630266292ba4cc597916.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_9d0cda1318af630266292ba4cc597916.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_7fbd983b780be67baf933c2b398aebff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7fbd983b780be67baf933c2b398aebff.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_1289c645fa1cc5ad2ee0f1a00a2e73d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_1289c645fa1cc5ad2ee0f1a00a2e73d7.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_afd5a8e74cf53ba9bf499663da566be1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_afd5a8e74cf53ba9bf499663da566be1.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_46822ed26cca454bbc7b308c9d2e37f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_46822ed26cca454bbc7b308c9d2e37f5.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_2de41ebdd765b225761a5b77dd12816a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_2de41ebdd765b225761a5b77dd12816a.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_55eac961855819881e71b17c162cfa78.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_55eac961855819881e71b17c162cfa78.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_8dfff8121d6ea2986e2c9cb4d7f4c09b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_8dfff8121d6ea2986e2c9cb4d7f4c09b.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_d6200e85ca32460ac723ca3cf5adeacb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_d6200e85ca32460ac723ca3cf5adeacb.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_ef47842b3dcf613653bbe1a09f038e04.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_ef47842b3dcf613653bbe1a09f038e04.jpg not downloaded yet
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_25b1deba6d457227652ce5fd5efa11b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_25b1deba6d457227652ce5fd5efa11b1.jpg not downloaded yet
2025-12-05 17:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK03236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_25b1deba6d457227652ce5fd5efa11b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a72210>
2025-12-05 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_25b1deba6d457227652ce5fd5efa11b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_25b1deba6d457227652ce5fd5efa11b1.jpg saved to cache
2025-12-05 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS09110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX68116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_ef47842b3dcf613653bbe1a09f038e04.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_d6200e85ca32460ac723ca3cf5adeacb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb72d0>
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_ef47842b3dcf613653bbe1a09f038e04.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_ef47842b3dcf613653bbe1a09f038e04.jpg saved to cache
2025-12-05 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS47593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU26238> (referer: https://www.auto1.com/v1/car-details-view/WU26238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0c150>
2025-12-05 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_d6200e85ca32460ac723ca3cf5adeacb.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_d6200e85ca32460ac723ca3cf5adeacb.jpg saved to cache
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984dbb1c-df49-503c-9055-744ce4ce47b4 with identifier: WU26238
2025-12-05 17:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984dbb1c-df49-503c-9055-744ce4ce47b4 with scrape type 1
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_46c71e6f9df9c15533d119e44f58af22.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg not downloaded yet
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_8dfff8121d6ea2986e2c9cb4d7f4c09b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB62921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_58376de9880cb282b05f8a3bc82b135f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg not downloaded yet
2025-12-05 17:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_f915cb33e8c932edde54dc85da52252a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg not downloaded yet
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_55eac961855819881e71b17c162cfa78.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg not downloaded yet
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg not downloaded yet
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg not downloaded yet
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5810250>
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_8dfff8121d6ea2986e2c9cb4d7f4c09b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_8dfff8121d6ea2986e2c9cb4d7f4c09b.jpg saved to cache
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_2e0470b42db539d423ffb4ac346b4770.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg not downloaded yet
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU43983> (referer: https://www.auto1.com/v1/car-details-view/WU43983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_202a71048648de8d7f7be78c50ae55ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg not downloaded yet
2025-12-05 17:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c98810>
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_55eac961855819881e71b17c162cfa78.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_55eac961855819881e71b17c162cfa78.jpg saved to cache
2025-12-05 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5998450>
2025-12-05 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_46c71e6f9df9c15533d119e44f58af22.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg not downloaded yet
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH38198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE87463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV05125> (referer: https://www.auto1.com/v1/car-details-view/KV05125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e81210>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a91a10>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb5490>
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_f915cb33e8c932edde54dc85da52252a.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg saved to cache
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a273463e-13bc-5500-9f37-bb04c46f5406 with identifier: WU43983
2025-12-05 17:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a273463e-13bc-5500-9f37-bb04c46f5406 with scrape type 2
2025-12-05 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a273463e-13bc-5500-9f37-bb04c46f5406 with scrape type 2
2025-12-05 17:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a273463e-13bc-5500-9f37-bb04c46f5406, identifier: WU43983
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_e65b492c75b6921f562e51fe3301d4ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg not downloaded yet
2025-12-05 17:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a273463e-13bc-5500-9f37-bb04c46f5406 with identifier: WU43983
2025-12-05 17:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a273463e-13bc-5500-9f37-bb04c46f5406 with identifier: WU43983
2025-12-05 17:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a273463e-13bc-5500-9f37-bb04c46f5406 spider: auto1.fr
2025-12-05 17:08:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a273463e-13bc-5500-9f37-bb04c46f5406 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:54:04Z',
'fuel_type': 'diesel',
'id': 'a273463e-13bc-5500-9f37-bb04c46f5406',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU43983',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 117141,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Active L2',
'transmission': 'manual',
'trim': 'Active L2',
'year': 2020}
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU43983%27 HTTP/1.1" 200 None
2025-12-05 17:08:57 [auto1.fr] INFO: Saving data for WU43983: {'auction_closing_time': 1765040044.0, 'created_time': 1764316874.182029, 'last_price_update_time': 1764954537.342617}
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU43983') HTTP/1.1" 204 0
2025-12-05 17:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg not downloaded yet
2025-12-05 17:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE58838> (referer: https://www.auto1.com/v1/car-details-view/LE58838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5880b10>
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg saved to cache
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fb62602-0d3d-546d-8a04-85f4d511ad8b with identifier: KV05125
2025-12-05 17:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fb62602-0d3d-546d-8a04-85f4d511ad8b with scrape type 2
2025-12-05 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fb62602-0d3d-546d-8a04-85f4d511ad8b with scrape type 2
2025-12-05 17:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4fb62602-0d3d-546d-8a04-85f4d511ad8b, identifier: KV05125
2025-12-05 17:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4fb62602-0d3d-546d-8a04-85f4d511ad8b with identifier: KV05125
2025-12-05 17:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4fb62602-0d3d-546d-8a04-85f4d511ad8b with identifier: KV05125
2025-12-05 17:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4fb62602-0d3d-546d-8a04-85f4d511ad8b with identifier: KV05125 to the API
2025-12-05 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV05125>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:15:28Z',
'fuel_type': 'diesel',
'id': '4fb62602-0d3d-546d-8a04-85f4d511ad8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV05125',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 113971,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kamiq 1.6 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV05125%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [auto1.fr] INFO: Saving data for KV05125: {'auction_closing_time': 1765037728.0, 'created_time': 1762276357.957026, 'last_price_update_time': 1764954538.244456}
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV05125') HTTP/1.1" 204 0
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg not downloaded yet
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD98246> (referer: https://www.auto1.com/v1/car-details-view/TD98246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4bb50>
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg saved to cache
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ed150>
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_2e0470b42db539d423ffb4ac346b4770.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg saved to cache
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1749850a-963c-5bc0-a42a-98500e9ed7aa with identifier: LE58838
2025-12-05 17:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1749850a-963c-5bc0-a42a-98500e9ed7aa with scrape type 1
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg not downloaded yet
2025-12-05 17:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg not downloaded yet
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE77297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f5210>
2025-12-05 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5782bd0>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea1250>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_202a71048648de8d7f7be78c50ae55ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f9490>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg') HTTP/1.1" 204 0
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg saved to cache
2025-12-05 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59933d0>
2025-12-05 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg saved to cache
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af28ecd4-8946-5186-8d1c-0cea42ab056d with identifier: TD98246
2025-12-05 17:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af28ecd4-8946-5186-8d1c-0cea42ab056d with scrape type 1
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_13a6ffdbe3fbe03a86f6e29987e50039.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_13a6ffdbe3fbe03a86f6e29987e50039.jpg not downloaded yet
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_2de41ebdd765b225761a5b77dd12816a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_ebba97b9e42b1683b64005fabbf65b57.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg not downloaded yet
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_65581ae5ea9dd512560949e5f931960d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_65581ae5ea9dd512560949e5f931960d.jpg not downloaded yet
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_71c3315b6744f17aef11b9c1acd07879.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg not downloaded yet
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f14410>
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_e65b492c75b6921f562e51fe3301d4ba.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg saved to cache
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3d150>
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_58376de9880cb282b05f8a3bc82b135f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg saved to cache
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_1167e2824066acfe80337ddff70fe8ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_1167e2824066acfe80337ddff70fe8ad.jpg not downloaded yet
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_afd5a8e74cf53ba9bf499663da566be1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_46822ed26cca454bbc7b308c9d2e37f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg not downloaded yet
2025-12-05 17:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_5ce14fd7b8642196416d85d3efa2d83a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5ce14fd7b8642196416d85d3efa2d83a.jpg not downloaded yet
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_a746d5d03d62de494ea7565dc6634e5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg not downloaded yet
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a27bd0>
2025-12-05 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_2de41ebdd765b225761a5b77dd12816a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_2de41ebdd765b225761a5b77dd12816a.jpg saved to cache
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c50a50>
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg saved to cache
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c4c10>
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F13%252F721397806ad341d60827455c58574c01%252Fpa%252FWU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg saved to cache
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 984dbb1c-df49-503c-9055-744ce4ce47b4
2025-12-05 17:09:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 984dbb1c-df49-503c-9055-744ce4ce47b4, skipping ID generation
2025-12-05 17:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984dbb1c-df49-503c-9055-744ce4ce47b4 with scrape type 1
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 984dbb1c-df49-503c-9055-744ce4ce47b4 from tracking dictionaries
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 984dbb1c-df49-503c-9055-744ce4ce47b4 sending to next pipeline
2025-12-05 17:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 984dbb1c-df49-503c-9055-744ce4ce47b4, identifier: WU26238
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_08952a6b4d4c5aa286731012b439a820.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_08952a6b4d4c5aa286731012b439a820.jpg not downloaded yet
2025-12-05 17:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 984dbb1c-df49-503c-9055-744ce4ce47b4 with identifier: WU26238
2025-12-05 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 984dbb1c-df49-503c-9055-744ce4ce47b4 with identifier: WU26238
2025-12-05 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 51552, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu26238', 'expiration_date': '2025-12-06t16:10:57z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boulogne-billancourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '984dbb1c-df49-503c-9055-744ce4ce47b4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66318}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70655}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55101}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71814}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69075}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61620}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50983}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50566}], 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 51552}
Failed validating None in schema:
False
On instance:
{'age_in_months': 74,
'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:10:57z',
'fuel_type': 'petrol',
'id': '984dbb1c-df49-503c-9055-744ce4ce47b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu26238',
'listing': 'auction',
'location': 'fr, boulogne-billancourt',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 51552,
'odometer_in_km': 51552,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure business',
'transmission': 'automatic',
'trim': 'allure business',
'year': 2019}
2025-12-05 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 984dbb1c-df49-503c-9055-744ce4ce47b4 spider: auto1.fr
2025-12-05 17:09:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 984dbb1c-df49-503c-9055-744ce4ce47b4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 51552, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu26238', 'expiration_date': '2025-12-06t16:10:57z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boulogne-billancourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '984dbb1c-df49-503c-9055-744ce4ce47b4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66318}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64828}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70655}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55101}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71814}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69075}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61620}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50983}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50566}], 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 51552}
Failed validating None in schema:
False
On instance:
{'age_in_months': 74,
'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:10:57z',
'fuel_type': 'petrol',
'id': '984dbb1c-df49-503c-9055-744ce4ce47b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu26238',
'listing': 'auction',
'location': 'fr, boulogne-billancourt',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 51552,
'odometer_in_km': 51552,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure business',
'transmission': 'automatic',
'trim': 'allure business',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:10:57Z',
'fuel_type': 'petrol',
'id': '984dbb1c-df49-503c-9055-744ce4ce47b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU26238',
'listing': 'auction',
'location': 'FR, Boulogne-Billancourt',
'make': 'Peugeot',
'model': '3008',
'odometer': 51552,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_46c71e6f9df9c15533d119e44f58af22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_0d15e56d4b4eddc5d1070f0b4d40a2aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_58376de9880cb282b05f8a3bc82b135f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_838eaf1b0bec75b23326ffbf05dd3a25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f915cb33e8c932edde54dc85da52252a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d13cf72b953f4dbb1afc1589adbe3150.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f329bc92d28eaa63360a3fb63a65c8c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_55497cfe245f7a49690f02e7e8a72dd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_a83b2ca9409a04b7d31ef8d638bfb05c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_bc7279dc2d6c197c4f32ec03b7e3d82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_2e0470b42db539d423ffb4ac346b4770.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_202a71048648de8d7f7be78c50ae55ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_7a17d9e77d17e47e6105ecddbeccce32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_e65b492c75b6921f562e51fe3301d4ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_d3384dcf6aacdbd1d1c7f87402d77373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984dbb1c-df49-503c-9055-744ce4ce47b4/984dbb1c-df49-503c-9055-744ce4ce47b4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/13/721397806ad341d60827455c58574c01/pa/WU26238_f801240b8c6fa80f89bffbea93b5ec08.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU26238%27 HTTP/1.1" 200 None
2025-12-05 17:09:01 [auto1.fr] INFO: Saving data for WU26238: {'created_time': 1764954541.9486, 'last_price_update_time': 1764954541.948613, 'auction_closing_time': 1765037457.0}
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU26238') HTTP/1.1" 204 0
2025-12-05 17:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_1289c645fa1cc5ad2ee0f1a00a2e73d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_4ed79c5565437a8ff36590a363bca6a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_4ed79c5565437a8ff36590a363bca6a7.jpg not downloaded yet
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB62921> (referer: https://www.auto1.com/v1/car-details-view/DB62921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE87463> (referer: https://www.auto1.com/v1/car-details-view/NE87463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG30804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS09110> (referer: https://www.auto1.com/v1/car-details-view/FS09110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3ee90>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_afd5a8e74cf53ba9bf499663da566be1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_afd5a8e74cf53ba9bf499663da566be1.jpg saved to cache
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57dc450>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_46822ed26cca454bbc7b308c9d2e37f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_46822ed26cca454bbc7b308c9d2e37f5.jpg saved to cache
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9ffd0>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg saved to cache
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d12e50>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg saved to cache
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_ea3e869dd0d57cbf6df82b10f090768c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_ea3e869dd0d57cbf6df82b10f090768c.jpg not downloaded yet
2025-12-05 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK03236> (referer: https://www.auto1.com/v1/car-details-view/HK03236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5847c50>
2025-12-05 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_1289c645fa1cc5ad2ee0f1a00a2e73d7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_1289c645fa1cc5ad2ee0f1a00a2e73d7.jpg saved to cache
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a73990>
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_71c3315b6744f17aef11b9c1acd07879.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg saved to cache
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c04b063b-513b-5a80-86d4-30969f2fd5c7 with identifier: DB62921
2025-12-05 17:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c04b063b-513b-5a80-86d4-30969f2fd5c7 with scrape type 1
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c04b063b-513b-5a80-86d4-30969f2fd5c7
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_ba3c61459b0e7b1263f7b891412d7364.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_51e75c1de2e2e933d045712415fb8dbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_326ee5e23210d43e40f01b5b73d82a75.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_73f77858c5e01c51e050dafa02bc0240.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_ee211884254ff06c182ec67a1a43d61b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_b990765101ea65762c35501d33128c43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_b23c8e0c116004c1d8003050d669b4bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_6d4d72364cbf8af37e686c70d3330a47.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_da98bc6a42453c4c653f158a664941b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_fc2c31d84f902f8a384b7c168291142e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg already downloaded
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F24%252F45242ff3a2f55c9a21d0087608fec494%252Fpa%252FDB62921_4a07f21f1203344e7361a3c83d5f69af.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png already downloaded
2025-12-05 17:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c04b063b-513b-5a80-86d4-30969f2fd5c7, identifier: DB62921
2025-12-05 17:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f295f5c5-c338-5bad-aca7-c24ede2712c2 with identifier: NE87463
2025-12-05 17:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f295f5c5-c338-5bad-aca7-c24ede2712c2 with scrape type 2
2025-12-05 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f295f5c5-c338-5bad-aca7-c24ede2712c2 with scrape type 2
2025-12-05 17:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f295f5c5-c338-5bad-aca7-c24ede2712c2, identifier: NE87463
2025-12-05 17:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87cbe656-81ad-5beb-819a-ebcef63df515 with identifier: FS09110
2025-12-05 17:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87cbe656-81ad-5beb-819a-ebcef63df515 with scrape type 1
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 87cbe656-81ad-5beb-819a-ebcef63df515
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_b132efccdd81f769986c12a12cd6d60b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_b132efccdd81f769986c12a12cd6d60b.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_5cb135ce919b13dadce26dab25f46b40.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_5cb135ce919b13dadce26dab25f46b40.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_a0c8c5b3c9cb755013f4f2f1e1db482b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_a0c8c5b3c9cb755013f4f2f1e1db482b.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_0892674c725e8c2b644e62034e94a864.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_0892674c725e8c2b644e62034e94a864.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_a6cb52ef79118796367aac25b78c7b16.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_a6cb52ef79118796367aac25b78c7b16.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_8cad24b1df92742ad19aeb1398607fa0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_8cad24b1df92742ad19aeb1398607fa0.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_66ab8f5f23119744740b23dc330ed178.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_66ab8f5f23119744740b23dc330ed178.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_860ca7507d0b4bbc318feeef597c0dbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_860ca7507d0b4bbc318feeef597c0dbe.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_9bd4e7406d23999f06ddfa325c671643.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_9bd4e7406d23999f06ddfa325c671643.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_dbcbd4b604885e1449aeca3185b3c4d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_dbcbd4b604885e1449aeca3185b3c4d0.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_086717c8482c84b0fcd843a54cd01bfc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_086717c8482c84b0fcd843a54cd01bfc.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_5eec3032f730fd1dab10730d22fb6688.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_5eec3032f730fd1dab10730d22fb6688.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_b06748a33479d7f179331dd23abbc554.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_b06748a33479d7f179331dd23abbc554.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_7e29526287de6c4ce6e35b0cb2e46765.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_7e29526287de6c4ce6e35b0cb2e46765.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_09a30c44a6d4ac3071603ad871ca800f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_09a30c44a6d4ac3071603ad871ca800f.jpg already downloaded
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd5%252F9ad58d24b179bb09e7a24e90be202994%252Fpa%252FFS09110_ab7f3194d3442e1691fa19bf78f2c012.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_ab7f3194d3442e1691fa19bf78f2c012.png already downloaded
2025-12-05 17:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87cbe656-81ad-5beb-819a-ebcef63df515, identifier: FS09110
2025-12-05 17:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_08952a6b4d4c5aa286731012b439a820.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_9f69c00d3920f55766346ab0066d9fc8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_9f69c00d3920f55766346ab0066d9fc8.jpg not downloaded yet
2025-12-05 17:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c04b063b-513b-5a80-86d4-30969f2fd5c7 with identifier: DB62921
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c04b063b-513b-5a80-86d4-30969f2fd5c7 with identifier: DB62921
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 38602, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/db62921', 'expiration_date': '2025-12-06t16:07:04z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 121, 'id': 'c04b063b-513b-5a80-86d4-30969f2fd5c7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65689}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88564}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65301}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53101}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94821}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 71219}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 38602}
Failed validating None in schema:
False
On instance:
{'age_in_months': 41,
'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:07:04z',
'fuel_type': 'petrol',
'id': 'c04b063b-513b-5a80-86d4-30969f2fd5c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/db62921',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 38602,
'odometer_in_km': 38602,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71219,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-26',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel pack',
'transmission': 'manual',
'trim': 'feel pack',
'year': 2022}
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c04b063b-513b-5a80-86d4-30969f2fd5c7 spider: auto1.fr
2025-12-05 17:09:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c04b063b-513b-5a80-86d4-30969f2fd5c7 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 38602, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/db62921', 'expiration_date': '2025-12-06t16:07:04z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg', 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 121, 'id': 'c04b063b-513b-5a80-86d4-30969f2fd5c7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65689}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88564}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65301}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53101}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51476}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94821}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 71219}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 38602}
Failed validating None in schema:
False
On instance:
{'age_in_months': 41,
'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:07:04z',
'fuel_type': 'petrol',
'id': 'c04b063b-513b-5a80-86d4-30969f2fd5c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/db62921',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 38602,
'odometer_in_km': 38602,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71219,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-26',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech feel pack',
'transmission': 'manual',
'trim': 'feel pack',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:07:04Z',
'fuel_type': 'petrol',
'id': 'c04b063b-513b-5a80-86d4-30969f2fd5c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB62921',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Citroen',
'model': 'C3',
'odometer': 38602,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg',
'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ba3c61459b0e7b1263f7b891412d7364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_51e75c1de2e2e933d045712415fb8dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_d3a20e31d4f5e49957203e3bf41e0d3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_c3ddb6fe77b6f40ab2aed211158af087.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_326ee5e23210d43e40f01b5b73d82a75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_8fd37a50d4e78ea45107a3514cfa51ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_73f77858c5e01c51e050dafa02bc0240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_ee211884254ff06c182ec67a1a43d61b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b990765101ea65762c35501d33128c43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_b23c8e0c116004c1d8003050d669b4bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_76ba9d5b222989ba6da8a83f1cbf966a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_3fe7f92ea9f6d5dd28b260b33fafc66c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_6d4d72364cbf8af37e686c70d3330a47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_da98bc6a42453c4c653f158a664941b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_fc2c31d84f902f8a384b7c168291142e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c04b063b-513b-5a80-86d4-30969f2fd5c7/c04b063b-513b-5a80-86d4-30969f2fd5c7_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71219,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img45/24/45242ff3a2f55c9a21d0087608fec494/pa/DB62921_4a07f21f1203344e7361a3c83d5f69af.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel Pack',
'transmission': 'manual',
'trim': 'Feel Pack',
'year': 2022}
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB62921%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [auto1.fr] INFO: Saving data for DB62921: {'created_time': 1764954544.701209, 'last_price_update_time': 1764954544.701219, 'auction_closing_time': 1765037224.0}
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB62921') HTTP/1.1" 204 0
2025-12-05 17:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f295f5c5-c338-5bad-aca7-c24ede2712c2 with identifier: NE87463
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f295f5c5-c338-5bad-aca7-c24ede2712c2 with identifier: NE87463
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168790 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
168790
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f295f5c5-c338-5bad-aca7-c24ede2712c2 spider: auto1.fr
2025-12-05 17:09:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f295f5c5-c338-5bad-aca7-c24ede2712c2 due to rule: high_mileage_for_country.json, error: 168790 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
168790
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:34:15Z',
'fuel_type': 'diesel',
'id': 'f295f5c5-c338-5bad-aca7-c24ede2712c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE87463',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'BMW',
'model': '2er',
'odometer': 168790,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-02',
'seats_number': 7,
'seller_name': None,
'title': 'BMW 2er 218d Gran Tourer Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2017}
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE87463%27 HTTP/1.1" 200 None
2025-12-05 17:09:04 [auto1.fr] INFO: Saving data for NE87463: {'auction_closing_time': 1765038855.0, 'created_time': 1764003968.939856, 'last_price_update_time': 1764954544.933906}
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE87463') HTTP/1.1" 204 0
2025-12-05 17:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87cbe656-81ad-5beb-819a-ebcef63df515 with identifier: FS09110
2025-12-05 17:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87cbe656-81ad-5beb-819a-ebcef63df515 with identifier: FS09110
2025-12-05 17:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182885 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
182885
2025-12-05 17:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 87cbe656-81ad-5beb-819a-ebcef63df515 spider: auto1.fr
2025-12-05 17:09:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 87cbe656-81ad-5beb-819a-ebcef63df515 due to rule: high_mileage_for_country.json, error: 182885 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
182885
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:01:43Z',
'fuel_type': 'diesel',
'id': '87cbe656-81ad-5beb-819a-ebcef63df515',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS09110',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Renault',
'model': 'Scenic',
'odometer': 182885,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_b132efccdd81f769986c12a12cd6d60b.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_5cb135ce919b13dadce26dab25f46b40.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_a0c8c5b3c9cb755013f4f2f1e1db482b.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_0892674c725e8c2b644e62034e94a864.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_a6cb52ef79118796367aac25b78c7b16.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_8cad24b1df92742ad19aeb1398607fa0.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_66ab8f5f23119744740b23dc330ed178.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_860ca7507d0b4bbc318feeef597c0dbe.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_9bd4e7406d23999f06ddfa325c671643.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_dbcbd4b604885e1449aeca3185b3c4d0.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_086717c8482c84b0fcd843a54cd01bfc.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_5eec3032f730fd1dab10730d22fb6688.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_b06748a33479d7f179331dd23abbc554.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_7e29526287de6c4ce6e35b0cb2e46765.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_09a30c44a6d4ac3071603ad871ca800f.jpg',
'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_ab7f3194d3442e1691fa19bf78f2c012.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_b132efccdd81f769986c12a12cd6d60b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_5cb135ce919b13dadce26dab25f46b40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_a0c8c5b3c9cb755013f4f2f1e1db482b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_0892674c725e8c2b644e62034e94a864.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_a6cb52ef79118796367aac25b78c7b16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_8cad24b1df92742ad19aeb1398607fa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_66ab8f5f23119744740b23dc330ed178.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_860ca7507d0b4bbc318feeef597c0dbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_9bd4e7406d23999f06ddfa325c671643.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_dbcbd4b604885e1449aeca3185b3c4d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_086717c8482c84b0fcd843a54cd01bfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_5eec3032f730fd1dab10730d22fb6688.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_b06748a33479d7f179331dd23abbc554.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_7e29526287de6c4ce6e35b0cb2e46765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_09a30c44a6d4ac3071603ad871ca800f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87cbe656-81ad-5beb-819a-ebcef63df515/87cbe656-81ad-5beb-819a-ebcef63df515_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 94711,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img9a/d5/9ad58d24b179bb09e7a24e90be202994/pa/FS09110_ab7f3194d3442e1691fa19bf78f2c012.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy Bose',
'transmission': 'automatic',
'trim': 'Bose',
'year': 2016}
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS09110%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [auto1.fr] INFO: Saving data for FS09110: {'created_time': 1764954545.165642, 'last_price_update_time': 1764954545.165653, 'auction_closing_time': 1765036903.0}
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FS09110') HTTP/1.1" 204 0
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5ce14fd7b8642196416d85d3efa2d83a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_5fb5bbd6e0610f5c3f02339117dbf871.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5fb5bbd6e0610f5c3f02339117dbf871.jpg not downloaded yet
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX68116> (referer: https://www.auto1.com/v1/car-details-view/VX68116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1a0f44-5950-5a44-bb2f-91095ba3e895 with identifier: HK03236
2025-12-05 17:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895 with scrape type 1
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_00001331b01afaf10c9c127a2b5c2d56.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_00001331b01afaf10c9c127a2b5c2d56.jpg not downloaded yet
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5927ed0>
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_08952a6b4d4c5aa286731012b439a820.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_08952a6b4d4c5aa286731012b439a820.jpg saved to cache
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_2571ae14abcdd26215e5f472561a14fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_2571ae14abcdd26215e5f472561a14fc.jpg not downloaded yet
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_ea3e869dd0d57cbf6df82b10f090768c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7fbd983b780be67baf933c2b398aebff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_d44eaadcb0afa4b1c4c77dfaf62c1595.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_d44eaadcb0afa4b1c4c77dfaf62c1595.jpg not downloaded yet
2025-12-05 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_9d0cda1318af630266292ba4cc597916.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_c02eca8eaeac35fb9d9c65941ad99266.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c02eca8eaeac35fb9d9c65941ad99266.jpg not downloaded yet
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_244a357daeb31d30aad409033f92e5d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_244a357daeb31d30aad409033f92e5d4.jpg not downloaded yet
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_618ac799b2e39c247855106d23d8d709.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_618ac799b2e39c247855106d23d8d709.jpg not downloaded yet
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ece850>
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_5ce14fd7b8642196416d85d3efa2d83a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5ce14fd7b8642196416d85d3efa2d83a.jpg saved to cache
2025-12-05 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a7dd0>
2025-12-05 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_a746d5d03d62de494ea7565dc6634e5a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg saved to cache
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c414d0>
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_ebba97b9e42b1683b64005fabbf65b57.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg saved to cache
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5881b90>
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21f1301716afdf2e2c0b5a7ac67f9ab%252Fpa%252FLE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg saved to cache
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1749850a-963c-5bc0-a42a-98500e9ed7aa
2025-12-05 17:09:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1749850a-963c-5bc0-a42a-98500e9ed7aa, skipping ID generation
2025-12-05 17:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1749850a-963c-5bc0-a42a-98500e9ed7aa with scrape type 1
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1749850a-963c-5bc0-a42a-98500e9ed7aa from tracking dictionaries
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1749850a-963c-5bc0-a42a-98500e9ed7aa sending to next pipeline
2025-12-05 17:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1749850a-963c-5bc0-a42a-98500e9ed7aa, identifier: LE58838
2025-12-05 17:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ec2397-c4fd-5df5-9d99-1f7c56cfa713 with identifier: VX68116
2025-12-05 17:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32ec2397-c4fd-5df5-9d99-1f7c56cfa713 with scrape type 2
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32ec2397-c4fd-5df5-9d99-1f7c56cfa713 with scrape type 2
2025-12-05 17:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32ec2397-c4fd-5df5-9d99-1f7c56cfa713, identifier: VX68116
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_766faf51e8f653182fac20e1cb8ac524.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_766faf51e8f653182fac20e1cb8ac524.jpg not downloaded yet
2025-12-05 17:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1749850a-963c-5bc0-a42a-98500e9ed7aa with identifier: LE58838
2025-12-05 17:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1749850a-963c-5bc0-a42a-98500e9ed7aa with identifier: LE58838
2025-12-05 17:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 6, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 vti access', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 157909, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/le58838', 'expiration_date': '2025-12-06t16:43:56z', 'origin_country_code': 'fr', 'trim': 'access', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, sainte luce sur loire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '1749850a-963c-5bc0-a42a-98500e9ed7aa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91629}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94256}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85217}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39936}], 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 157909}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:43:56z',
'fuel_type': 'petrol',
'id': '1749850a-963c-5bc0-a42a-98500e9ed7aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/le58838',
'listing': 'auction',
'location': 'fr, sainte luce sur loire',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 157909,
'odometer_in_km': 157909,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-13',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 vti access',
'transmission': 'manual',
'trim': 'access',
'year': 2016}
2025-12-05 17:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 1749850a-963c-5bc0-a42a-98500e9ed7aa spider: auto1.fr
2025-12-05 17:09:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1749850a-963c-5bc0-a42a-98500e9ed7aa due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 6, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 vti access', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 157909, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/le58838', 'expiration_date': '2025-12-06t16:43:56z', 'origin_country_code': 'fr', 'trim': 'access', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, sainte luce sur loire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '1749850a-963c-5bc0-a42a-98500e9ed7aa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91629}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94256}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85217}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39936}], 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 157909}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:43:56z',
'fuel_type': 'petrol',
'id': '1749850a-963c-5bc0-a42a-98500e9ed7aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/le58838',
'listing': 'auction',
'location': 'fr, sainte luce sur loire',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 157909,
'odometer_in_km': 157909,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-13',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 vti access',
'transmission': 'manual',
'trim': 'access',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:43:56Z',
'fuel_type': 'petrol',
'id': '1749850a-963c-5bc0-a42a-98500e9ed7aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE58838',
'listing': 'auction',
'location': 'FR, Sainte Luce sur Loire',
'make': 'Peugeot',
'model': '308',
'odometer': 157909,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_c25b3176c1655f8fabfa160d9e6f120d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_66bccd2fea5cb1d1b2062c9dc9987736.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_ebba97b9e42b1683b64005fabbf65b57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_71c3315b6744f17aef11b9c1acd07879.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_7b1f486e51a72902b181b6ae472c5ca3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1749850a-963c-5bc0-a42a-98500e9ed7aa/1749850a-963c-5bc0-a42a-98500e9ed7aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21f1301716afdf2e2c0b5a7ac67f9ab/pa/LE58838_a746d5d03d62de494ea7565dc6634e5a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 VTi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2016}
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE58838%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [auto1.fr] INFO: Saving data for LE58838: {'created_time': 1764954547.071095, 'last_price_update_time': 1764954547.071104, 'auction_closing_time': 1765039436.0}
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LE58838') HTTP/1.1" 204 0
2025-12-05 17:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32ec2397-c4fd-5df5-9d99-1f7c56cfa713 with identifier: VX68116
2025-12-05 17:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32ec2397-c4fd-5df5-9d99-1f7c56cfa713 with identifier: VX68116
2025-12-05 17:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32ec2397-c4fd-5df5-9d99-1f7c56cfa713 with identifier: VX68116 to the API
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX68116>
{'auction_title': '',
'c_o_2_emission_value': 32,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:35:25Z',
'fuel_type': 'hybrid',
'id': '32ec2397-c4fd-5df5-9d99-1f7c56cfa713',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX68116',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 70215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
'transmission': 'automatic',
'trim': 'Shine Pack',
'year': 2022}
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX68116%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [auto1.fr] INFO: Saving data for VX68116: {'auction_closing_time': 1765038925.0, 'created_time': 1762337592.822967, 'last_price_update_time': 1764954547.671082}
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX68116') HTTP/1.1" 204 0
2025-12-05 17:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_00001331b01afaf10c9c127a2b5c2d56.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_c251aad858bf13f02f165e5e7e441d12.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_6e73c1bdf5447cd2a643e15f9624c3af.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_3ebcfdb0850e84ab31e46954934e2768.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_3ebcfdb0850e84ab31e46954934e2768.jpg not downloaded yet
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_41d0bd71b04c668f5e141f3cbb52eecd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_41d0bd71b04c668f5e141f3cbb52eecd.jpg not downloaded yet
2025-12-05 17:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH38198> (referer: https://www.auto1.com/v1/car-details-view/CH38198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS47593> (referer: https://www.auto1.com/v1/car-details-view/VS47593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE77297> (referer: https://www.auto1.com/v1/car-details-view/HE77297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_f9d187d852583e2a4799f606d3816fd6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_f9d187d852583e2a4799f606d3816fd6.jpg not downloaded yet
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_4ef8b241488eb9abfcc674eab323ab8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4ef8b241488eb9abfcc674eab323ab8b.jpg not downloaded yet
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5892d90>
2025-12-05 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_ea3e869dd0d57cbf6df82b10f090768c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_ea3e869dd0d57cbf6df82b10f090768c.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c599b810>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_7fbd983b780be67baf933c2b398aebff.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7fbd983b780be67baf933c2b398aebff.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3e6d0>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_9d0cda1318af630266292ba4cc597916.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_9d0cda1318af630266292ba4cc597916.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_2571ae14abcdd26215e5f472561a14fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_618ac799b2e39c247855106d23d8d709.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:08 [scrapy.extensions.logstats] INFO: Crawled 729 pages (at 67 pages/min), scraped 169 items (at 15 items/min)
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_c25a4632592753ded094382c0cf0cdde.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c25a4632592753ded094382c0cf0cdde.jpg not downloaded yet
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_77a206e773002bce669cf2895e9d26e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_77a206e773002bce669cf2895e9d26e6.jpg not downloaded yet
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_bd2c98a4c94301b38e8223983d46283a.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_bd2c98a4c94301b38e8223983d46283a.png not downloaded yet
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582f8d0>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_00001331b01afaf10c9c127a2b5c2d56.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_00001331b01afaf10c9c127a2b5c2d56.jpg saved to cache
2025-12-05 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf6e10>
2025-12-05 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_c251aad858bf13f02f165e5e7e441d12.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_c251aad858bf13f02f165e5e7e441d12.jpg saved to cache
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594d510>
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_6e73c1bdf5447cd2a643e15f9624c3af.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_6e73c1bdf5447cd2a643e15f9624c3af.jpg saved to cache
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9811cd5-47a0-55ea-b5cf-1ffa7376f119 with identifier: CH38198
2025-12-05 17:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9811cd5-47a0-55ea-b5cf-1ffa7376f119 with scrape type 2
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9811cd5-47a0-55ea-b5cf-1ffa7376f119 with scrape type 2
2025-12-05 17:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d9811cd5-47a0-55ea-b5cf-1ffa7376f119, identifier: CH38198
2025-12-05 17:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 with identifier: VS47593
2025-12-05 17:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 with scrape type 1
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg not downloaded yet
2025-12-05 17:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbbce94-ec41-5f1a-8c33-5a0e2065894e with identifier: HE77297
2025-12-05 17:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbbce94-ec41-5f1a-8c33-5a0e2065894e with scrape type 2
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cbbce94-ec41-5f1a-8c33-5a0e2065894e with scrape type 2
2025-12-05 17:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0cbbce94-ec41-5f1a-8c33-5a0e2065894e, identifier: HE77297
2025-12-05 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c02eca8eaeac35fb9d9c65941ad99266.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg not downloaded yet
2025-12-05 17:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9811cd5-47a0-55ea-b5cf-1ffa7376f119 with identifier: CH38198
2025-12-05 17:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9811cd5-47a0-55ea-b5cf-1ffa7376f119 with identifier: CH38198
2025-12-05 17:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 66516, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ch38198', 'expiration_date': '2025-12-06t16:08:20z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 135, 'id': 'd9811cd5-47a0-55ea-b5cf-1ffa7376f119', 'current_year_diff': 4, 'age_in_months': 51, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 66516}
Failed validating None in schema:
False
On instance:
{'age_in_months': 51,
'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:08:20z',
'fuel_type': 'petrol',
'id': 'd9811cd5-47a0-55ea-b5cf-1ffa7376f119',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ch38198',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 66516,
'odometer_in_km': 66516,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-19',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
2025-12-05 17:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d9811cd5-47a0-55ea-b5cf-1ffa7376f119 spider: auto1.fr
2025-12-05 17:09:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d9811cd5-47a0-55ea-b5cf-1ffa7376f119 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 66516, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ch38198', 'expiration_date': '2025-12-06t16:08:20z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 135, 'id': 'd9811cd5-47a0-55ea-b5cf-1ffa7376f119', 'current_year_diff': 4, 'age_in_months': 51, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 66516}
Failed validating None in schema:
False
On instance:
{'age_in_months': 51,
'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:08:20z',
'fuel_type': 'petrol',
'id': 'd9811cd5-47a0-55ea-b5cf-1ffa7376f119',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ch38198',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 66516,
'odometer_in_km': 66516,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-19',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:08:20Z',
'fuel_type': 'petrol',
'id': 'd9811cd5-47a0-55ea-b5cf-1ffa7376f119',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH38198',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Peugeot',
'model': '2008',
'odometer': 66516,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-19',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH38198%27 HTTP/1.1" 200 None
2025-12-05 17:09:09 [auto1.fr] INFO: Saving data for CH38198: {'auction_closing_time': 1765037300.0, 'created_time': 1764349436.990566, 'last_price_update_time': 1764954549.931031}
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH38198') HTTP/1.1" 204 0
2025-12-05 17:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0cbbce94-ec41-5f1a-8c33-5a0e2065894e with identifier: HE77297
2025-12-05 17:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0cbbce94-ec41-5f1a-8c33-5a0e2065894e with identifier: HE77297
2025-12-05 17:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0cbbce94-ec41-5f1a-8c33-5a0e2065894e with identifier: HE77297 to the API
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE77297>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2025-12-06T16:04:11Z',
'fuel_type': 'diesel',
'id': '0cbbce94-ec41-5f1a-8c33-5a0e2065894e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE77297',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 102090,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2018}
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE77297%27 HTTP/1.1" 200 None
2025-12-05 17:09:10 [auto1.fr] INFO: Saving data for HE77297: {'auction_closing_time': 1765037051.0, 'created_time': 1764608750.231744, 'last_price_update_time': 1764954550.262095}
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HE77297') HTTP/1.1" 204 0
2025-12-05 17:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_244a357daeb31d30aad409033f92e5d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_0645998ed62fcf7caeb51aca4b338aec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg not downloaded yet
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_9d461789a7f7aa1408d93c06854dfae7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9d461789a7f7aa1408d93c06854dfae7.jpg not downloaded yet
2025-12-05 17:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG30804> (referer: https://www.auto1.com/v1/car-details-view/SG30804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg not downloaded yet
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_9198d9db0d4af7443d4dbae33c97407d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9198d9db0d4af7443d4dbae33c97407d.jpg not downloaded yet
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c1c10>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_2571ae14abcdd26215e5f472561a14fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_2571ae14abcdd26215e5f472561a14fc.jpg saved to cache
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59054d0>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_618ac799b2e39c247855106d23d8d709.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_618ac799b2e39c247855106d23d8d709.jpg saved to cache
2025-12-05 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7b39e90>
2025-12-05 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_c02eca8eaeac35fb9d9c65941ad99266.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c02eca8eaeac35fb9d9c65941ad99266.jpg saved to cache
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_3ebcfdb0850e84ab31e46954934e2768.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_821754dfb20e4a9972882ae45b95440f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg not downloaded yet
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_41d0bd71b04c668f5e141f3cbb52eecd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_0db9bda41366eab1b8338a4eb86208fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_0db9bda41366eab1b8338a4eb86208fa.jpg not downloaded yet
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg not downloaded yet
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a90710>
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_244a357daeb31d30aad409033f92e5d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_244a357daeb31d30aad409033f92e5d4.jpg saved to cache
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6886dcba-42df-50c9-9e7d-a11a9171acad with identifier: SG30804
2025-12-05 17:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6886dcba-42df-50c9-9e7d-a11a9171acad with scrape type 2
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6886dcba-42df-50c9-9e7d-a11a9171acad with scrape type 2
2025-12-05 17:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6886dcba-42df-50c9-9e7d-a11a9171acad, identifier: SG30804
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_08999ab8fac76c6938fcc63c4eb9698e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_08999ab8fac76c6938fcc63c4eb9698e.jpg not downloaded yet
2025-12-05 17:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6886dcba-42df-50c9-9e7d-a11a9171acad with identifier: SG30804
2025-12-05 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6886dcba-42df-50c9-9e7d-a11a9171acad with identifier: SG30804
2025-12-05 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 71592, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg30804', 'expiration_date': '2025-12-06t16:40:53z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 140, 'id': '6886dcba-42df-50c9-9e7d-a11a9171acad', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 71592}
Failed validating None in schema:
False
On instance:
{'age_in_months': 60,
'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 155,
'expiration_date': '2025-12-06t16:40:53z',
'fuel_type': 'petrol',
'id': '6886dcba-42df-50c9-9e7d-a11a9171acad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg30804',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 71592,
'odometer_in_km': 71592,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-22',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2020}
2025-12-05 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6886dcba-42df-50c9-9e7d-a11a9171acad spider: auto1.fr
2025-12-05 17:09:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6886dcba-42df-50c9-9e7d-a11a9171acad due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 71592, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg30804', 'expiration_date': '2025-12-06t16:40:53z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 140, 'id': '6886dcba-42df-50c9-9e7d-a11a9171acad', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 71592}
Failed validating None in schema:
False
On instance:
{'age_in_months': 60,
'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 155,
'expiration_date': '2025-12-06t16:40:53z',
'fuel_type': 'petrol',
'id': '6886dcba-42df-50c9-9e7d-a11a9171acad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sg30804',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 71592,
'odometer_in_km': 71592,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-22',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 155,
'expiration_date': '2025-12-06T16:40:53Z',
'fuel_type': 'petrol',
'id': '6886dcba-42df-50c9-9e7d-a11a9171acad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG30804',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Peugeot',
'model': '2008',
'odometer': 71592,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2020}
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG30804%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [auto1.fr] INFO: Saving data for SG30804: {'auction_closing_time': 1765039253.0, 'created_time': 1764004022.479604, 'last_price_update_time': 1764954551.687153}
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SG30804') HTTP/1.1" 204 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_887e91075908514d2a7f282a9cd40a33.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg not downloaded yet
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_f9d187d852583e2a4799f606d3816fd6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_766faf51e8f653182fac20e1cb8ac524.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_ec6ed5e9c335e596f39d8f4f579b517e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_ec6ed5e9c335e596f39d8f4f579b517e.jpg not downloaded yet
2025-12-05 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF13728> (referer: https://www.auto1.com/v1/car-details-view/PF13728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f17790>
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_3ebcfdb0850e84ab31e46954934e2768.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_3ebcfdb0850e84ab31e46954934e2768.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0e390>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_41d0bd71b04c668f5e141f3cbb52eecd.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_41d0bd71b04c668f5e141f3cbb52eecd.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg not downloaded yet
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_65581ae5ea9dd512560949e5f931960d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_1167e2824066acfe80337ddff70fe8ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_7897b9d1b3aa3b59349c6e35ae59811c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_7897b9d1b3aa3b59349c6e35ae59811c.jpg not downloaded yet
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg not downloaded yet
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9ea10>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_f9d187d852583e2a4799f606d3816fd6.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_f9d187d852583e2a4799f606d3816fd6.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e4a290>
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_766faf51e8f653182fac20e1cb8ac524.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_766faf51e8f653182fac20e1cb8ac524.jpg saved to cache
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ec4c89-fc34-5f3c-99df-afd06d9a1374 with identifier: PF13728
2025-12-05 17:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ec4c89-fc34-5f3c-99df-afd06d9a1374 with scrape type 2
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ec4c89-fc34-5f3c-99df-afd06d9a1374 with scrape type 2
2025-12-05 17:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25ec4c89-fc34-5f3c-99df-afd06d9a1374, identifier: PF13728
2025-12-05 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_13a6ffdbe3fbe03a86f6e29987e50039.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_5e37aee16730a8691825fc3adbf4d39a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5e37aee16730a8691825fc3adbf4d39a.jpg not downloaded yet
2025-12-05 17:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25ec4c89-fc34-5f3c-99df-afd06d9a1374 with identifier: PF13728
2025-12-05 17:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25ec4c89-fc34-5f3c-99df-afd06d9a1374 with identifier: PF13728
2025-12-05 17:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25ec4c89-fc34-5f3c-99df-afd06d9a1374 with identifier: PF13728 to the API
2025-12-05 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF13728>
{'auction_title': '',
'c_o_2_emission_value': 52,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2025-12-06T16:36:48Z',
'fuel_type': 'hybrid',
'id': '25ec4c89-fc34-5f3c-99df-afd06d9a1374',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF13728',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'BMW',
'model': 'X3',
'odometer': 58820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF13728%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [auto1.fr] INFO: Saving data for PF13728: {'auction_closing_time': 1765039008.0, 'created_time': 1762337486.163268, 'last_price_update_time': 1764954553.291986}
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF13728') HTTP/1.1" 204 0
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_d44eaadcb0afa4b1c4c77dfaf62c1595.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_9cd41b661525fb56c045578f92c3826c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg not downloaded yet
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_bd2c98a4c94301b38e8223983d46283a.png> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9d461789a7f7aa1408d93c06854dfae7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_4b36613b3c114eab8ad4624e9456dbb4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4b36613b3c114eab8ad4624e9456dbb4.jpg not downloaded yet
2025-12-05 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_4ed79c5565437a8ff36590a363bca6a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_13dcf16a838f75df464e796a7127cc71.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg not downloaded yet
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_c87f34ad6caf506dc2c5109b66491b19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_c87f34ad6caf506dc2c5109b66491b19.jpg not downloaded yet
2025-12-05 17:09:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb9f10>
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_65581ae5ea9dd512560949e5f931960d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_65581ae5ea9dd512560949e5f931960d.jpg saved to cache
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f55d0>
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_1167e2824066acfe80337ddff70fe8ad.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_1167e2824066acfe80337ddff70fe8ad.jpg saved to cache
2025-12-05 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5dd90>
2025-12-05 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_13a6ffdbe3fbe03a86f6e29987e50039.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_13a6ffdbe3fbe03a86f6e29987e50039.jpg saved to cache
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_9f69c00d3920f55766346ab0066d9fc8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_08999ab8fac76c6938fcc63c4eb9698e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg not downloaded yet
2025-12-05 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_5a36abf4364bf7ba554f086da5fdfdf7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5a36abf4364bf7ba554f086da5fdfdf7.jpg not downloaded yet
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_35f3d948497aaefc1950b847f4213072.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg not downloaded yet
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ded7d0>
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_d44eaadcb0afa4b1c4c77dfaf62c1595.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_d44eaadcb0afa4b1c4c77dfaf62c1595.jpg saved to cache
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4def3d0>
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg saved to cache
2025-12-05 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:14 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:09:14 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:09:14 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:09:14 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d10b10>
2025-12-05 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_15.png HTTP/1.1" 201 0
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_bd2c98a4c94301b38e8223983d46283a.png') HTTP/1.1" 204 0
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_bd2c98a4c94301b38e8223983d46283a.png saved to cache
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c0750>
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_9d461789a7f7aa1408d93c06854dfae7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9d461789a7f7aa1408d93c06854dfae7.jpg saved to cache
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e08a90>
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_4ed79c5565437a8ff36590a363bca6a7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_4ed79c5565437a8ff36590a363bca6a7.jpg saved to cache
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_ec6ed5e9c335e596f39d8f4f579b517e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_2b9cf270ab7c75e6b8f84df054304aca.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_2b9cf270ab7c75e6b8f84df054304aca.jpg not downloaded yet
2025-12-05 17:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_0db9bda41366eab1b8338a4eb86208fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg not downloaded yet
2025-12-05 17:09:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de3e10>
2025-12-05 17:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_9f69c00d3920f55766346ab0066d9fc8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_9f69c00d3920f55766346ab0066d9fc8.jpg saved to cache
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cdc110>
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_08999ab8fac76c6938fcc63c4eb9698e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_08999ab8fac76c6938fcc63c4eb9698e.jpg saved to cache
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_6dc6db820d65d4d8075c6e23772f9aab.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_6dc6db820d65d4d8075c6e23772f9aab.jpg not downloaded yet
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591b450>
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_821754dfb20e4a9972882ae45b95440f.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg saved to cache
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_281f507800e4a4b46d7136273e9b2f98.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg not downloaded yet
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_c87f34ad6caf506dc2c5109b66491b19.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5a36abf4364bf7ba554f086da5fdfdf7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd7950>
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_ec6ed5e9c335e596f39d8f4f579b517e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_ec6ed5e9c335e596f39d8f4f579b517e.jpg saved to cache
2025-12-05 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5826250>
2025-12-05 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_0db9bda41366eab1b8338a4eb86208fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_0db9bda41366eab1b8338a4eb86208fa.jpg saved to cache
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg not downloaded yet
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png not downloaded yet
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c790f390>
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg saved to cache
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c591a0d0>
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_c87f34ad6caf506dc2c5109b66491b19.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_c87f34ad6caf506dc2c5109b66491b19.jpg saved to cache
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c9ab50>
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_5a36abf4364bf7ba554f086da5fdfdf7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5a36abf4364bf7ba554f086da5fdfdf7.jpg saved to cache
2025-12-05 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5e37aee16730a8691825fc3adbf4d39a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5fb5bbd6e0610f5c3f02339117dbf871.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4b36613b3c114eab8ad4624e9456dbb4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_7897b9d1b3aa3b59349c6e35ae59811c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_6dc6db820d65d4d8075c6e23772f9aab.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_2b9cf270ab7c75e6b8f84df054304aca.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de7c90>
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_5e37aee16730a8691825fc3adbf4d39a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5e37aee16730a8691825fc3adbf4d39a.jpg saved to cache
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b87b90>
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_5fb5bbd6e0610f5c3f02339117dbf871.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5fb5bbd6e0610f5c3f02339117dbf871.jpg saved to cache
2025-12-05 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ba5090>
2025-12-05 17:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_4b36613b3c114eab8ad4624e9456dbb4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4b36613b3c114eab8ad4624e9456dbb4.jpg saved to cache
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4baa7d0>
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg saved to cache
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb2850>
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg saved to cache
2025-12-05 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b947d0>
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_887e91075908514d2a7f282a9cd40a33.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg saved to cache
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b87d50>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_13dcf16a838f75df464e796a7127cc71.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg saved to cache
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4baa110>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_9cd41b661525fb56c045578f92c3826c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg saved to cache
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b9eed0>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg saved to cache
2025-12-05 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bd6b90>
2025-12-05 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_7897b9d1b3aa3b59349c6e35ae59811c.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_7897b9d1b3aa3b59349c6e35ae59811c.jpg saved to cache
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb9e10>
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg saved to cache
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bdc990>
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_6dc6db820d65d4d8075c6e23772f9aab.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_6dc6db820d65d4d8075c6e23772f9aab.jpg saved to cache
2025-12-05 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:21 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:09:21 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:09:21 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:09:21 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4baad10>
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_15.png HTTP/1.1" 201 0
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png') HTTP/1.1" 204 0
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png saved to cache
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bc0c50>
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_2b9cf270ab7c75e6b8f84df054304aca.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_2b9cf270ab7c75e6b8f84df054304aca.jpg saved to cache
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bba250>
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg saved to cache
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ba5d10>
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg saved to cache
2025-12-05 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c25a4632592753ded094382c0cf0cdde.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9198d9db0d4af7443d4dbae33c97407d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_77a206e773002bce669cf2895e9d26e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4ef8b241488eb9abfcc674eab323ab8b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7806e7fb2e7218fa06d8cacbc1cc4bde.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e20950>
2025-12-05 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_281f507800e4a4b46d7136273e9b2f98.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg saved to cache
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5879790>
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_35f3d948497aaefc1950b847f4213072.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg saved to cache
2025-12-05 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_45acd8b51a649f31db0850c2bdd1486a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c86f4a10>
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9e%252F949e0cb31359c2af62669a76b4fa0cb9%252Fpa%252FTD98246_c25a4632592753ded094382c0cf0cdde.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c25a4632592753ded094382c0cf0cdde.jpg saved to cache
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item af28ecd4-8946-5186-8d1c-0cea42ab056d
2025-12-05 17:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af28ecd4-8946-5186-8d1c-0cea42ab056d, skipping ID generation
2025-12-05 17:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af28ecd4-8946-5186-8d1c-0cea42ab056d with scrape type 1
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af28ecd4-8946-5186-8d1c-0cea42ab056d from tracking dictionaries
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af28ecd4-8946-5186-8d1c-0cea42ab056d sending to next pipeline
2025-12-05 17:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: af28ecd4-8946-5186-8d1c-0cea42ab056d, identifier: TD98246
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb3150>
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_9198d9db0d4af7443d4dbae33c97407d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9198d9db0d4af7443d4dbae33c97407d.jpg saved to cache
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5970fd0>
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_77a206e773002bce669cf2895e9d26e6.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_77a206e773002bce669cf2895e9d26e6.jpg saved to cache
2025-12-05 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c598a2d0>
2025-12-05 17:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_4ef8b241488eb9abfcc674eab323ab8b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4ef8b241488eb9abfcc674eab323ab8b.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f0c90>
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F28%252F9c28b79b34c91900caef349c761659b7%252Fpa%252FHK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895
2025-12-05 17:09:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a1a0f44-5950-5a44-bb2f-91095ba3e895, skipping ID generation
2025-12-05 17:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895 with scrape type 1
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2a1a0f44-5950-5a44-bb2f-91095ba3e895 from tracking dictionaries
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a1a0f44-5950-5a44-bb2f-91095ba3e895 sending to next pipeline
2025-12-05 17:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a1a0f44-5950-5a44-bb2f-91095ba3e895, identifier: HK03236
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59af610>
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_7806e7fb2e7218fa06d8cacbc1cc4bde.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7806e7fb2e7218fa06d8cacbc1cc4bde.jpg saved to cache
2025-12-05 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: af28ecd4-8946-5186-8d1c-0cea42ab056d with identifier: TD98246
2025-12-05 17:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: af28ecd4-8946-5186-8d1c-0cea42ab056d with identifier: TD98246
2025-12-05 17:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: af28ecd4-8946-5186-8d1c-0cea42ab056d with identifier: TD98246 to the API
2025-12-05 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c25a4632592753ded094382c0cf0cdde.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 299,
'expiration_date': '2025-12-06T16:36:09Z',
'fuel_type': 'electro',
'id': 'af28ecd4-8946-5186-8d1c-0cea42ab056d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD98246',
'listing': 'auction',
'location': 'FR, Décines-Charpieu',
'make': 'Tesla',
'model': 'Model Y',
'odometer': 22142,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2540474,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_13a6ffdbe3fbe03a86f6e29987e50039.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267140,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_65581ae5ea9dd512560949e5f931960d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2198833,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_1167e2824066acfe80337ddff70fe8ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5ce14fd7b8642196416d85d3efa2d83a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_08952a6b4d4c5aa286731012b439a820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1945252,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_4ed79c5565437a8ff36590a363bca6a7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_ea3e869dd0d57cbf6df82b10f090768c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1830922,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_9f69c00d3920f55766346ab0066d9fc8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2331597,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_5fb5bbd6e0610f5c3f02339117dbf871.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_2571ae14abcdd26215e5f472561a14fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c02eca8eaeac35fb9d9c65941ad99266.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_618ac799b2e39c247855106d23d8d709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_3ebcfdb0850e84ab31e46954934e2768.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_f9d187d852583e2a4799f606d3816fd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_c25a4632592753ded094382c0cf0cdde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af28ecd4-8946-5186-8d1c-0cea42ab056d/af28ecd4-8946-5186-8d1c-0cea42ab056d_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 75194,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img94/9e/949e0cb31359c2af62669a76b4fa0cb9/pa/TD98246_bd2c98a4c94301b38e8223983d46283a.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Tesla Model Y Standard Range',
'transmission': 'automatic',
'trim': '',
'year': 2024}
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD98246%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [auto1.fr] INFO: Saving data for TD98246: {'created_time': 1764954568.24216, 'last_price_update_time': 1764954568.242172, 'auction_closing_time': 1765038969.0}
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TD98246') HTTP/1.1" 204 0
2025-12-05 17:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a1a0f44-5950-5a44-bb2f-91095ba3e895 with identifier: HK03236
2025-12-05 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a1a0f44-5950-5a44-bb2f-91095ba3e895 with identifier: HK03236
2025-12-05 17:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a1a0f44-5950-5a44-bb2f-91095ba3e895 with identifier: HK03236 to the API
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 105,
'expiration_date': '2025-12-06T16:34:12Z',
'fuel_type': 'petrol',
'id': '2a1a0f44-5950-5a44-bb2f-91095ba3e895',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK03236',
'listing': 'auction',
'location': 'FR',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 92871,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_00001331b01afaf10c9c127a2b5c2d56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_d44eaadcb0afa4b1c4c77dfaf62c1595.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_244a357daeb31d30aad409033f92e5d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_766faf51e8f653182fac20e1cb8ac524.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_41d0bd71b04c668f5e141f3cbb52eecd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4ef8b241488eb9abfcc674eab323ab8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_77a206e773002bce669cf2895e9d26e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_df47f73b4a9a6e165057c1ee5f98ff34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9d461789a7f7aa1408d93c06854dfae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_9198d9db0d4af7443d4dbae33c97407d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_0db9bda41366eab1b8338a4eb86208fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_08999ab8fac76c6938fcc63c4eb9698e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_ec6ed5e9c335e596f39d8f4f579b517e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_7897b9d1b3aa3b59349c6e35ae59811c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5e37aee16730a8691825fc3adbf4d39a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_4b36613b3c114eab8ad4624e9456dbb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26108,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_c87f34ad6caf506dc2c5109b66491b19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19768,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_5a36abf4364bf7ba554f086da5fdfdf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24876,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_2b9cf270ab7c75e6b8f84df054304aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a1a0f44-5950-5a44-bb2f-91095ba3e895/2a1a0f44-5950-5a44-bb2f-91095ba3e895_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24944,
'Height': 360,
'OriginUrl': 'https://img-pa.auto1.com/img9c/28/9c28b79b34c91900caef349c761659b7/pa/HK03236_6dc6db820d65d4d8075c6e23772f9aab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-23',
'seats_number': 4,
'seller_name': None,
'title': 'Alfa Romeo MiTo 0.9 TwinAir Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2018}
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK03236%27 HTTP/1.1" 200 None
2025-12-05 17:09:28 [auto1.fr] INFO: Saving data for HK03236: {'created_time': 1764954568.664338, 'last_price_update_time': 1764954568.664349, 'auction_closing_time': 1765038852.0}
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK03236') HTTP/1.1" 204 0
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4bad0>
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_45acd8b51a649f31db0850c2bdd1486a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_45acd8b51a649f31db0850c2bdd1486a.jpg saved to cache
2025-12-05 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c50350>
2025-12-05 17:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fc1%252F73c104b004cf2a57becb362ed656bb7f%252Fpa%252FTR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg saved to cache
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d54d7462-87f6-5279-aca1-f66bb557c40c
2025-12-05 17:09:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d54d7462-87f6-5279-aca1-f66bb557c40c, skipping ID generation
2025-12-05 17:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54d7462-87f6-5279-aca1-f66bb557c40c with scrape type 1
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d54d7462-87f6-5279-aca1-f66bb557c40c from tracking dictionaries
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d54d7462-87f6-5279-aca1-f66bb557c40c sending to next pipeline
2025-12-05 17:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d54d7462-87f6-5279-aca1-f66bb557c40c, identifier: TR31605
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_b20f04f44b13c72512b6b5b4ab2752fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d54d7462-87f6-5279-aca1-f66bb557c40c with identifier: TR31605
2025-12-05 17:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d54d7462-87f6-5279-aca1-f66bb557c40c with identifier: TR31605
2025-12-05 17:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d54d7462-87f6-5279-aca1-f66bb557c40c with identifier: TR31605 to the API
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:07:29Z',
'fuel_type': 'hybrid',
'id': 'd54d7462-87f6-5279-aca1-f66bb557c40c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR31605',
'listing': 'auction',
'location': 'FR, Saint Brieuc',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 50063,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7806e7fb2e7218fa06d8cacbc1cc4bde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_45acd8b51a649f31db0850c2bdd1486a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_a86b5a10ae03f6ed39590ede842d1f73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_c251aad858bf13f02f165e5e7e441d12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_6e73c1bdf5447cd2a643e15f9624c3af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_9d0cda1318af630266292ba4cc597916.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_7fbd983b780be67baf933c2b398aebff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_1289c645fa1cc5ad2ee0f1a00a2e73d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_afd5a8e74cf53ba9bf499663da566be1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_46822ed26cca454bbc7b308c9d2e37f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_2de41ebdd765b225761a5b77dd12816a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_55eac961855819881e71b17c162cfa78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_8dfff8121d6ea2986e2c9cb4d7f4c09b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_d6200e85ca32460ac723ca3cf5adeacb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_ef47842b3dcf613653bbe1a09f038e04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54d7462-87f6-5279-aca1-f66bb557c40c/d54d7462-87f6-5279-aca1-f66bb557c40c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/c1/73c104b004cf2a57becb362ed656bb7f/pa/TR31605_25b1deba6d457227652ce5fd5efa11b1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2023}
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR31605%27 HTTP/1.1" 200 None
2025-12-05 17:09:29 [auto1.fr] INFO: Saving data for TR31605: {'created_time': 1764954569.595369, 'last_price_update_time': 1764954569.595379, 'auction_closing_time': 1765037249.0}
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR31605') HTTP/1.1" 204 0
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b31290>
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_b20f04f44b13c72512b6b5b4ab2752fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_b20f04f44b13c72512b6b5b4ab2752fa.jpg saved to cache
2025-12-05 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c982123ba6befa82bdb8a649b9d2387d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_73916adc51dd625cab22b85edf216668.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c598b2d0>
2025-12-05 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F13%252F9f13e7a1ef2405dd074b07dbe6bc8a9c%252Fpa%252FVS47593_0645998ed62fcf7caeb51aca4b338aec.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg saved to cache
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88
2025-12-05 17:09:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88, skipping ID generation
2025-12-05 17:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 with scrape type 1
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 from tracking dictionaries
2025-12-05 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 sending to next pipeline
2025-12-05 17:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88, identifier: VS47593
2025-12-05 17:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 with identifier: VS47593
2025-12-05 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 with identifier: VS47593
2025-12-05 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 85004, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs47593', 'expiration_date': '2025-12-06t16:14:26z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, aubière', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '4fe222ef-4ea2-582c-ad05-47c3a8f05c88', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66916}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2669947}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2596571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62925}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2567985}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2640378}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79901}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2514304}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2506916}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60614}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2730977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68540}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2678181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 99663}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 85386}], 'current_year_diff': 7, 'age_in_months': 87, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 85004}
Failed validating None in schema:
False
On instance:
{'age_in_months': 87,
'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:14:26z',
'fuel_type': 'petrol',
'id': '4fe222ef-4ea2-582c-ad05-47c3a8f05c88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs47593',
'listing': 'auction',
'location': 'fr, aubière',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 85004,
'odometer_in_km': 85004,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596571,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2567985,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640378,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514304,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2506916,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2678181,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 85386,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2018}
2025-12-05 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 spider: auto1.fr
2025-12-05 17:09:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4fe222ef-4ea2-582c-ad05-47c3a8f05c88 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 85004, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs47593', 'expiration_date': '2025-12-06t16:14:26z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, aubière', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '4fe222ef-4ea2-582c-ad05-47c3a8f05c88', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66916}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2669947}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2596571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62925}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2567985}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2640378}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79901}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2514304}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2506916}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60614}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2730977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68540}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2678181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 99663}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 85386}], 'current_year_diff': 7, 'age_in_months': 87, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 85004}
Failed validating None in schema:
False
On instance:
{'age_in_months': 87,
'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:14:26z',
'fuel_type': 'petrol',
'id': '4fe222ef-4ea2-582c-ad05-47c3a8f05c88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vs47593',
'listing': 'auction',
'location': 'fr, aubière',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 85004,
'odometer_in_km': 85004,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596571,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2567985,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640378,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514304,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2506916,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2678181,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 85386,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:14:26Z',
'fuel_type': 'petrol',
'id': '4fe222ef-4ea2-582c-ad05-47c3a8f05c88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS47593',
'listing': 'auction',
'location': 'FR, Aubière',
'make': 'Peugeot',
'model': '308',
'odometer': 85004,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_082648d0ccbc6e18d56e24c2b55cb244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_0645998ed62fcf7caeb51aca4b338aec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596571,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_e4006f9f73f0d5f80adbab0c7fe34e68.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_821754dfb20e4a9972882ae45b95440f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2567985,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_f458e84fdfe95f53344078ed8d61d9ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640378,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_887e91075908514d2a7f282a9cd40a33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b7bb178f5b6a55c72ed9d5987e186907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_fed4a4beb6f9da45bd9903866e5c7dd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514304,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_9cd41b661525fb56c045578f92c3826c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2506916,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_13dcf16a838f75df464e796a7127cc71.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_b35d1592e9b945f7139e9ea83ec6a00e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730977,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_35f3d948497aaefc1950b847f4213072.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_47ab105d1c1d9c84ee5ac89f41ab3665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2678181,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_281f507800e4a4b46d7136273e9b2f98.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_bd7aecf72ea7a8e9720bcb0c5b75f520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe222ef-4ea2-582c-ad05-47c3a8f05c88/4fe222ef-4ea2-582c-ad05-47c3a8f05c88_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 85386,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img9f/13/9f13e7a1ef2405dd074b07dbe6bc8a9c/pa/VS47593_c5e2558554b1ead1e1a12bffe0d1ab53.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS47593%27 HTTP/1.1" 200 None
2025-12-05 17:09:30 [auto1.fr] INFO: Saving data for VS47593: {'created_time': 1764954570.661644, 'last_price_update_time': 1764954570.661655, 'auction_closing_time': 1765037666.0}
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS47593') HTTP/1.1" 204 0
2025-12-05 17:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE79287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT21371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0bd90>
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_c982123ba6befa82bdb8a649b9d2387d.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c982123ba6befa82bdb8a649b9d2387d.jpg saved to cache
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579d010>
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe7%252F21e7384a4471b6b35e66082cf9e10530%252Fpa%252FZV76318_73916adc51dd625cab22b85edf216668.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_73916adc51dd625cab22b85edf216668.jpg saved to cache
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66288a38-49af-523e-b9f6-00083a1dc563
2025-12-05 17:09:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66288a38-49af-523e-b9f6-00083a1dc563, skipping ID generation
2025-12-05 17:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66288a38-49af-523e-b9f6-00083a1dc563 with scrape type 1
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 66288a38-49af-523e-b9f6-00083a1dc563 from tracking dictionaries
2025-12-05 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66288a38-49af-523e-b9f6-00083a1dc563 sending to next pipeline
2025-12-05 17:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66288a38-49af-523e-b9f6-00083a1dc563, identifier: ZV76318
2025-12-05 17:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66288a38-49af-523e-b9f6-00083a1dc563 with identifier: ZV76318
2025-12-05 17:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66288a38-49af-523e-b9f6-00083a1dc563 with identifier: ZV76318
2025-12-05 17:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 66288a38-49af-523e-b9f6-00083a1dc563 with identifier: ZV76318 to the API
2025-12-05 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_73916adc51dd625cab22b85edf216668.jpg>
{'auction_title': '',
'c_o_2_emission_value': 12,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:46:10Z',
'fuel_type': 'electro',
'id': '66288a38-49af-523e-b9f6-00083a1dc563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV76318',
'listing': 'auction',
'location': 'FR, Saint Herblain',
'make': 'BMW',
'model': 'i3',
'odometer': 68748,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_73916adc51dd625cab22b85edf216668.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2711666,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c982123ba6befa82bdb8a649b9d2387d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_b20f04f44b13c72512b6b5b4ab2752fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_148cfd45c7c0b6d007b3fdbef5672e63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2894182,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_0255282317e414bb15f84fde9d6564f4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_80e1542937604ad7aca4046a491cfb5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2500302,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_127fbaab0c9626bf10c22f285ae40d12.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2662678,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_81fc131aa78ead8e4a462b3b9fc4952e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2706089,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2776fcca7610bbce6a6d2856895693b3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2862590,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_c64dd6366434c0150027d2380f08a3b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_7f2ebd7d229b9e26bb9f8a370fd593fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730794,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_4f3be4f67cc21487bf57a7ac8e4def6f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_a12c77d35b3cc3967d1deaac7419b202.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_ae30842d3b065f848a157f47663bd23f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_44f459e56908fe3990beb5fc507c05cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66288a38-49af-523e-b9f6-00083a1dc563/66288a38-49af-523e-b9f6-00083a1dc563_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/e7/21e7384a4471b6b35e66082cf9e10530/pa/ZV76318_2e53219b27d4c3a8fa4dee97d72401e6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-04',
'seats_number': 4,
'seller_name': None,
'title': 'BMW i3 i3 REX',
'transmission': 'automatic',
'trim': 'REX',
'year': 2017}
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV76318%27 HTTP/1.1" 200 None
2025-12-05 17:09:32 [auto1.fr] INFO: Saving data for ZV76318: {'created_time': 1764954572.460563, 'last_price_update_time': 1764954572.460573, 'auction_closing_time': 1765039570.0}
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV76318') HTTP/1.1" 204 0
2025-12-05 17:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS07097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF51092> (referer: https://www.auto1.com/v1/car-details-view/LF51092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ac3dbb-9306-5c84-a574-1274986a8015 with identifier: LF51092
2025-12-05 17:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ac3dbb-9306-5c84-a574-1274986a8015 with scrape type 1
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_bb48846a45a1fa3797a113a8317970f0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_bb48846a45a1fa3797a113a8317970f0.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_0ee19de4f581779f4954f2d2bdb7582b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_0ee19de4f581779f4954f2d2bdb7582b.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_13e01c2e8213b03f5e549a192039658b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_13e01c2e8213b03f5e549a192039658b.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_20ef5345133c1093e1bff15dfb461386.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_20ef5345133c1093e1bff15dfb461386.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_519b3d0a9e54eb858c51ddf23a81d754.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_519b3d0a9e54eb858c51ddf23a81d754.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_30ac19fb0d1bcccce5b08b662489d2c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_30ac19fb0d1bcccce5b08b662489d2c4.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_9fd9f5b29efa8ccbe87bda52f3435ede.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_9fd9f5b29efa8ccbe87bda52f3435ede.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_8d745077a78607df352a467a8437f8cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_8d745077a78607df352a467a8437f8cb.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_37c0facebbf44b0d5344eb02697f9dd4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_37c0facebbf44b0d5344eb02697f9dd4.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_aedf3fa01c0140c6803a01b1c11f27e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_aedf3fa01c0140c6803a01b1c11f27e7.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_f9729940a0d2be1c3a4ecf71788f1be3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_f9729940a0d2be1c3a4ecf71788f1be3.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_868d6f312eae3afec24dac80944bf2ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_868d6f312eae3afec24dac80944bf2ee.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_6583d8ab8a633c9ef560b4571c8e14b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_6583d8ab8a633c9ef560b4571c8e14b0.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_d9e458c7b12eae7be2dd77beb527a309.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_d9e458c7b12eae7be2dd77beb527a309.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_03a2dcf8879e170bb2ab2b5fc74c125e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_03a2dcf8879e170bb2ab2b5fc74c125e.jpg not downloaded yet
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_e899b7e0fde7bebded63109a2890dd26.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_e899b7e0fde7bebded63109a2890dd26.png not downloaded yet
2025-12-05 17:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH03574> (referer: https://www.auto1.com/v1/car-details-view/CH03574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_e899b7e0fde7bebded63109a2890dd26.png> (referer: https://www.auto1.com/)
2025-12-05 17:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473a1d3e-6840-53e1-87a6-9b7a6d822f00 with identifier: CH03574
2025-12-05 17:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00 with scrape type 1
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_fc5f86f592007c5efffea82a505bca1b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_fc5f86f592007c5efffea82a505bca1b.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_dd0ceff957ebaa47739efb0bfd892e63.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_dd0ceff957ebaa47739efb0bfd892e63.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_6136e8868319a2f31bafee778b1d9632.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_6136e8868319a2f31bafee778b1d9632.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_5d556888956dacbe6d99385379a963d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_5d556888956dacbe6d99385379a963d7.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_b07433dd9d747fd157bd4b8b6c4a9cd1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_b07433dd9d747fd157bd4b8b6c4a9cd1.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_d126ee8973248781ebf91070f56b6c23.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_d126ee8973248781ebf91070f56b6c23.jpg not downloaded yet
2025-12-05 17:09:38 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:09:38 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:09:38 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:09:38 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cde990>
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_15.png HTTP/1.1" 201 0
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_e899b7e0fde7bebded63109a2890dd26.png') HTTP/1.1" 204 0
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_e899b7e0fde7bebded63109a2890dd26.png saved to cache
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_1a531411fd4472292b73e73ecc6fced5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_1a531411fd4472292b73e73ecc6fced5.jpg not downloaded yet
2025-12-05 17:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_03a2dcf8879e170bb2ab2b5fc74c125e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_2fc78e7d41eac8b9da8b14e7209d42e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_2fc78e7d41eac8b9da8b14e7209d42e8.jpg not downloaded yet
2025-12-05 17:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB85417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_db9a0050756025e13e49beb7f3035419.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_db9a0050756025e13e49beb7f3035419.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_3767492920798814e823e22486a84484.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_3767492920798814e823e22486a84484.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_76dab12ca69e96e56b08a4e03ec6e436.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_76dab12ca69e96e56b08a4e03ec6e436.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_e8400c250fd28e98824a6b023ee7d295.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_e8400c250fd28e98824a6b023ee7d295.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_f731c6cffce31a89b43b67cfcb575dbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_f731c6cffce31a89b43b67cfcb575dbe.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_bb4139552a6bf03ff970410fd2a4c725.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_bb4139552a6bf03ff970410fd2a4c725.jpg not downloaded yet
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_0bacc3ba1c455b768d03592217a86293.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_0bacc3ba1c455b768d03592217a86293.jpg not downloaded yet
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c46150>
2025-12-05 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_03a2dcf8879e170bb2ab2b5fc74c125e.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_03a2dcf8879e170bb2ab2b5fc74c125e.jpg saved to cache
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_4b143aca13e6b9f935be6af4dd307698.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_4b143aca13e6b9f935be6af4dd307698.png not downloaded yet
2025-12-05 17:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE99013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_d126ee8973248781ebf91070f56b6c23.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_1a531411fd4472292b73e73ecc6fced5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd08d0>
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_d126ee8973248781ebf91070f56b6c23.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_d126ee8973248781ebf91070f56b6c23.jpg saved to cache
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cde9d0>
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_1a531411fd4472292b73e73ecc6fced5.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_1a531411fd4472292b73e73ecc6fced5.jpg saved to cache
2025-12-05 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_4b143aca13e6b9f935be6af4dd307698.png> (referer: https://www.auto1.com/)
2025-12-05 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_0bacc3ba1c455b768d03592217a86293.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:40 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:09:40 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:09:40 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:09:40 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e4b750>
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_15.png HTTP/1.1" 201 0
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_4b143aca13e6b9f935be6af4dd307698.png') HTTP/1.1" 204 0
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_4b143aca13e6b9f935be6af4dd307698.png saved to cache
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eff250>
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_0bacc3ba1c455b768d03592217a86293.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_0bacc3ba1c455b768d03592217a86293.jpg saved to cache
2025-12-05 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_bb4139552a6bf03ff970410fd2a4c725.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_f731c6cffce31a89b43b67cfcb575dbe.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585c1d0>
2025-12-05 17:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_bb4139552a6bf03ff970410fd2a4c725.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_bb4139552a6bf03ff970410fd2a4c725.jpg saved to cache
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cde790>
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_f731c6cffce31a89b43b67cfcb575dbe.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_f731c6cffce31a89b43b67cfcb575dbe.jpg saved to cache
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_e8400c250fd28e98824a6b023ee7d295.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d0e50>
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_e8400c250fd28e98824a6b023ee7d295.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_e8400c250fd28e98824a6b023ee7d295.jpg saved to cache
2025-12-05 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_76dab12ca69e96e56b08a4e03ec6e436.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d2c50>
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_76dab12ca69e96e56b08a4e03ec6e436.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_76dab12ca69e96e56b08a4e03ec6e436.jpg saved to cache
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_3767492920798814e823e22486a84484.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579f650>
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_3767492920798814e823e22486a84484.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_3767492920798814e823e22486a84484.jpg saved to cache
2025-12-05 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_db9a0050756025e13e49beb7f3035419.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_2fc78e7d41eac8b9da8b14e7209d42e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c46550>
2025-12-05 17:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_db9a0050756025e13e49beb7f3035419.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_db9a0050756025e13e49beb7f3035419.jpg saved to cache
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d0dd0>
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_2fc78e7d41eac8b9da8b14e7209d42e8.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_2fc78e7d41eac8b9da8b14e7209d42e8.jpg saved to cache
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_b07433dd9d747fd157bd4b8b6c4a9cd1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cded10>
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_b07433dd9d747fd157bd4b8b6c4a9cd1.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_b07433dd9d747fd157bd4b8b6c4a9cd1.jpg saved to cache
2025-12-05 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_5d556888956dacbe6d99385379a963d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_6136e8868319a2f31bafee778b1d9632.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a4f150>
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_5d556888956dacbe6d99385379a963d7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_5d556888956dacbe6d99385379a963d7.jpg saved to cache
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f1510>
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_6136e8868319a2f31bafee778b1d9632.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_6136e8868319a2f31bafee778b1d9632.jpg saved to cache
2025-12-05 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_dd0ceff957ebaa47739efb0bfd892e63.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0ae50>
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_dd0ceff957ebaa47739efb0bfd892e63.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_dd0ceff957ebaa47739efb0bfd892e63.jpg saved to cache
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_fc5f86f592007c5efffea82a505bca1b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c587bf50>
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F3f%252F693f3f5270cfa10e1bad95ae10a40c8b%252Fpa%252FCH03574_fc5f86f592007c5efffea82a505bca1b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_fc5f86f592007c5efffea82a505bca1b.jpg saved to cache
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00
2025-12-05 17:09:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 473a1d3e-6840-53e1-87a6-9b7a6d822f00, skipping ID generation
2025-12-05 17:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00 with scrape type 1
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 473a1d3e-6840-53e1-87a6-9b7a6d822f00 from tracking dictionaries
2025-12-05 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 473a1d3e-6840-53e1-87a6-9b7a6d822f00 sending to next pipeline
2025-12-05 17:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 473a1d3e-6840-53e1-87a6-9b7a6d822f00, identifier: CH03574
2025-12-05 17:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 473a1d3e-6840-53e1-87a6-9b7a6d822f00 with identifier: CH03574
2025-12-05 17:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 473a1d3e-6840-53e1-87a6-9b7a6d822f00 with identifier: CH03574
2025-12-05 17:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 197932 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
197932
2025-12-05 17:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 473a1d3e-6840-53e1-87a6-9b7a6d822f00 spider: auto1.fr
2025-12-05 17:09:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 473a1d3e-6840-53e1-87a6-9b7a6d822f00 due to rule: high_mileage_for_country.json, error: 197932 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
197932
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:14:59Z',
'fuel_type': 'diesel',
'id': '473a1d3e-6840-53e1-87a6-9b7a6d822f00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH03574',
'listing': 'auction',
'location': 'FR, Pamiers',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 197932,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3228907,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_fc5f86f592007c5efffea82a505bca1b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3234592,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_dd0ceff957ebaa47739efb0bfd892e63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_6136e8868319a2f31bafee778b1d9632.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3192600,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_5d556888956dacbe6d99385379a963d7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3182360,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_b07433dd9d747fd157bd4b8b6c4a9cd1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3256158,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_d126ee8973248781ebf91070f56b6c23.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3252371,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_1a531411fd4472292b73e73ecc6fced5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_2fc78e7d41eac8b9da8b14e7209d42e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3037923,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_db9a0050756025e13e49beb7f3035419.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3113056,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_3767492920798814e823e22486a84484.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3295201,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_76dab12ca69e96e56b08a4e03ec6e436.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3046973,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_e8400c250fd28e98824a6b023ee7d295.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_f731c6cffce31a89b43b67cfcb575dbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3140024,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_bb4139552a6bf03ff970410fd2a4c725.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_0bacc3ba1c455b768d03592217a86293.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473a1d3e-6840-53e1-87a6-9b7a6d822f00/473a1d3e-6840-53e1-87a6-9b7a6d822f00_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 67209,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img69/3f/693f3f5270cfa10e1bad95ae10a40c8b/pa/CH03574_4b143aca13e6b9f935be6af4dd307698.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.6 TDI Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2019}
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH03574%27 HTTP/1.1" 200 None
2025-12-05 17:09:45 [auto1.fr] INFO: Saving data for CH03574: {'created_time': 1764954585.935155, 'last_price_update_time': 1764954585.935164, 'auction_closing_time': 1765037699.0}
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH03574') HTTP/1.1" 204 0
2025-12-05 17:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_d9e458c7b12eae7be2dd77beb527a309.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c933d0>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_d9e458c7b12eae7be2dd77beb527a309.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_d9e458c7b12eae7be2dd77beb527a309.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_6583d8ab8a633c9ef560b4571c8e14b0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_868d6f312eae3afec24dac80944bf2ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c900d0>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_6583d8ab8a633c9ef560b4571c8e14b0.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_6583d8ab8a633c9ef560b4571c8e14b0.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_f9729940a0d2be1c3a4ecf71788f1be3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d3150>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_868d6f312eae3afec24dac80944bf2ee.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_868d6f312eae3afec24dac80944bf2ee.jpg saved to cache
2025-12-05 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_aedf3fa01c0140c6803a01b1c11f27e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f0b450>
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_f9729940a0d2be1c3a4ecf71788f1be3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_f9729940a0d2be1c3a4ecf71788f1be3.jpg saved to cache
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5770990>
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_aedf3fa01c0140c6803a01b1c11f27e7.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_aedf3fa01c0140c6803a01b1c11f27e7.jpg saved to cache
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_37c0facebbf44b0d5344eb02697f9dd4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59a19d0>
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_37c0facebbf44b0d5344eb02697f9dd4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_37c0facebbf44b0d5344eb02697f9dd4.jpg saved to cache
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_8d745077a78607df352a467a8437f8cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c43510>
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_8d745077a78607df352a467a8437f8cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_8d745077a78607df352a467a8437f8cb.jpg saved to cache
2025-12-05 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_9fd9f5b29efa8ccbe87bda52f3435ede.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a4fc50>
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_9fd9f5b29efa8ccbe87bda52f3435ede.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_9fd9f5b29efa8ccbe87bda52f3435ede.jpg saved to cache
2025-12-05 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_30ac19fb0d1bcccce5b08b662489d2c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5878e10>
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_30ac19fb0d1bcccce5b08b662489d2c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_30ac19fb0d1bcccce5b08b662489d2c4.jpg saved to cache
2025-12-05 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_519b3d0a9e54eb858c51ddf23a81d754.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5973f50>
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_519b3d0a9e54eb858c51ddf23a81d754.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_519b3d0a9e54eb858c51ddf23a81d754.jpg saved to cache
2025-12-05 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_20ef5345133c1093e1bff15dfb461386.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS94579/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c598a290>
2025-12-05 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_20ef5345133c1093e1bff15dfb461386.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_20ef5345133c1093e1bff15dfb461386.jpg saved to cache
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_0ee19de4f581779f4954f2d2bdb7582b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_13e01c2e8213b03f5e549a192039658b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_bb48846a45a1fa3797a113a8317970f0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e49c90>
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_0ee19de4f581779f4954f2d2bdb7582b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_0ee19de4f581779f4954f2d2bdb7582b.jpg saved to cache
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5937d10>
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_13e01c2e8213b03f5e549a192039658b.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_13e01c2e8213b03f5e549a192039658b.jpg saved to cache
2025-12-05 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a9d750>
2025-12-05 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fbc%252F05bcba35a814e7f59c3803e961d533db%252Fpa%252FLF51092_bb48846a45a1fa3797a113a8317970f0.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_bb48846a45a1fa3797a113a8317970f0.jpg saved to cache
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0ac3dbb-9306-5c84-a574-1274986a8015
2025-12-05 17:09:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0ac3dbb-9306-5c84-a574-1274986a8015, skipping ID generation
2025-12-05 17:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ac3dbb-9306-5c84-a574-1274986a8015 with scrape type 1
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e0ac3dbb-9306-5c84-a574-1274986a8015 from tracking dictionaries
2025-12-05 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0ac3dbb-9306-5c84-a574-1274986a8015 sending to next pipeline
2025-12-05 17:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0ac3dbb-9306-5c84-a574-1274986a8015, identifier: LF51092
2025-12-05 17:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0ac3dbb-9306-5c84-a574-1274986a8015 with identifier: LF51092
2025-12-05 17:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0ac3dbb-9306-5c84-a574-1274986a8015 with identifier: LF51092
2025-12-05 17:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190855 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
190855
2025-12-05 17:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e0ac3dbb-9306-5c84-a574-1274986a8015 spider: auto1.fr
2025-12-05 17:09:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e0ac3dbb-9306-5c84-a574-1274986a8015 due to rule: high_mileage_for_country.json, error: 190855 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
190855
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:40:15Z',
'fuel_type': 'diesel',
'id': 'e0ac3dbb-9306-5c84-a574-1274986a8015',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF51092',
'listing': 'auction',
'location': 'FR, Cholet',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 190855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_bb48846a45a1fa3797a113a8317970f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_0ee19de4f581779f4954f2d2bdb7582b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_13e01c2e8213b03f5e549a192039658b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_20ef5345133c1093e1bff15dfb461386.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_519b3d0a9e54eb858c51ddf23a81d754.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_30ac19fb0d1bcccce5b08b662489d2c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_9fd9f5b29efa8ccbe87bda52f3435ede.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_8d745077a78607df352a467a8437f8cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_37c0facebbf44b0d5344eb02697f9dd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_aedf3fa01c0140c6803a01b1c11f27e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_f9729940a0d2be1c3a4ecf71788f1be3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_868d6f312eae3afec24dac80944bf2ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_6583d8ab8a633c9ef560b4571c8e14b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_d9e458c7b12eae7be2dd77beb527a309.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_03a2dcf8879e170bb2ab2b5fc74c125e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ac3dbb-9306-5c84-a574-1274986a8015/e0ac3dbb-9306-5c84-a574-1274986a8015_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 114987,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img05/bc/05bcba35a814e7f59c3803e961d533db/pa/LF51092_e899b7e0fde7bebded63109a2890dd26.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy Black Edition',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2017}
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF51092%27 HTTP/1.1" 200 None
2025-12-05 17:09:50 [auto1.fr] INFO: Saving data for LF51092: {'created_time': 1764954590.584718, 'last_price_update_time': 1764954590.584728, 'auction_closing_time': 1765039215.0}
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF51092') HTTP/1.1" 204 0
2025-12-05 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ29729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG57630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB12713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA76671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL71607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT88767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS07097> (referer: https://www.auto1.com/v1/car-details-view/YS07097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b30f4d-3f56-51af-b3aa-be6273260b04 with identifier: YS07097
2025-12-05 17:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b30f4d-3f56-51af-b3aa-be6273260b04 with scrape type 2
2025-12-05 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b30f4d-3f56-51af-b3aa-be6273260b04 with scrape type 2
2025-12-05 17:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9b30f4d-3f56-51af-b3aa-be6273260b04, identifier: YS07097
2025-12-05 17:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9b30f4d-3f56-51af-b3aa-be6273260b04 with identifier: YS07097
2025-12-05 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9b30f4d-3f56-51af-b3aa-be6273260b04 with identifier: YS07097
2025-12-05 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'automatic', 'odometer': 28628, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys07097', 'expiration_date': '2025-12-06t16:45:58z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'c9b30f4d-3f56-51af-b3aa-be6273260b04', 'current_year_diff': 3, 'age_in_months': 43, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 28628}
Failed validating None in schema:
False
On instance:
{'age_in_months': 43,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:45:58z',
'fuel_type': 'petrol',
'id': 'c9b30f4d-3f56-51af-b3aa-be6273260b04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys07097',
'listing': 'auction',
'location': 'fr, villenoy',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 28628,
'odometer_in_km': 28628,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-12',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 turbo elegance',
'transmission': 'automatic',
'trim': 'elegance',
'year': 2022}
2025-12-05 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: c9b30f4d-3f56-51af-b3aa-be6273260b04 spider: auto1.fr
2025-12-05 17:09:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c9b30f4d-3f56-51af-b3aa-be6273260b04 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'automatic', 'odometer': 28628, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys07097', 'expiration_date': '2025-12-06t16:45:58z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'c9b30f4d-3f56-51af-b3aa-be6273260b04', 'current_year_diff': 3, 'age_in_months': 43, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 28628}
Failed validating None in schema:
False
On instance:
{'age_in_months': 43,
'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:45:58z',
'fuel_type': 'petrol',
'id': 'c9b30f4d-3f56-51af-b3aa-be6273260b04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys07097',
'listing': 'auction',
'location': 'fr, villenoy',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 28628,
'odometer_in_km': 28628,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-12',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 turbo elegance',
'transmission': 'automatic',
'trim': 'elegance',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:45:58Z',
'fuel_type': 'petrol',
'id': 'c9b30f4d-3f56-51af-b3aa-be6273260b04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS07097',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Opel',
'model': 'Corsa',
'odometer': 28628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2022}
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS07097%27 HTTP/1.1" 200 None
2025-12-05 17:09:53 [auto1.fr] INFO: Saving data for YS07097: {'auction_closing_time': 1765039558.0, 'created_time': 1764090121.4739, 'last_price_update_time': 1764954593.937891}
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS07097') HTTP/1.1" 204 0
2025-12-05 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB85417> (referer: https://www.auto1.com/v1/car-details-view/JB85417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE99013> (referer: https://www.auto1.com/v1/car-details-view/LE99013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9549e7d1-1478-514d-a89f-5d3db70552cc with identifier: JB85417
2025-12-05 17:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9549e7d1-1478-514d-a89f-5d3db70552cc with scrape type 2
2025-12-05 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9549e7d1-1478-514d-a89f-5d3db70552cc with scrape type 2
2025-12-05 17:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9549e7d1-1478-514d-a89f-5d3db70552cc, identifier: JB85417
2025-12-05 17:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9549e7d1-1478-514d-a89f-5d3db70552cc with identifier: JB85417
2025-12-05 17:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9549e7d1-1478-514d-a89f-5d3db70552cc with identifier: JB85417
2025-12-05 17:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9549e7d1-1478-514d-a89f-5d3db70552cc with identifier: JB85417 to the API
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB85417>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2025-12-06T16:04:15Z',
'fuel_type': 'petrol',
'id': '9549e7d1-1478-514d-a89f-5d3db70552cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB85417',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Ford',
'model': 'Puma',
'odometer': 33418,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2022}
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB85417%27 HTTP/1.1" 200 None
2025-12-05 17:09:54 [auto1.fr] INFO: Saving data for JB85417: {'auction_closing_time': 1765037055.0, 'created_time': 1762277787.715498, 'last_price_update_time': 1764954594.599834}
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB85417') HTTP/1.1" 204 0
2025-12-05 17:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cc3cf9b-4ee1-5fc3-969c-235219b29541 with identifier: LE99013
2025-12-05 17:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc3cf9b-4ee1-5fc3-969c-235219b29541 with scrape type 2
2025-12-05 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cc3cf9b-4ee1-5fc3-969c-235219b29541 with scrape type 2
2025-12-05 17:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6cc3cf9b-4ee1-5fc3-969c-235219b29541, identifier: LE99013
2025-12-05 17:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6cc3cf9b-4ee1-5fc3-969c-235219b29541 with identifier: LE99013
2025-12-05 17:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6cc3cf9b-4ee1-5fc3-969c-235219b29541 with identifier: LE99013
2025-12-05 17:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6cc3cf9b-4ee1-5fc3-969c-235219b29541 with identifier: LE99013 to the API
2025-12-05 17:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LE99013>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 159,
'expiration_date': '2025-12-06T16:59:33Z',
'fuel_type': 'petrol',
'id': '6cc3cf9b-4ee1-5fc3-969c-235219b29541',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE99013',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 68448,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2019}
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE99013%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [auto1.fr] INFO: Saving data for LE99013: {'auction_closing_time': 1765040373.0, 'created_time': 1762337863.306697, 'last_price_update_time': 1764954595.175028}
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LE99013') HTTP/1.1" 204 0
2025-12-05 17:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT21371> (referer: https://www.auto1.com/v1/car-details-view/FT21371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb958ae2-5c6f-51da-b1e0-25d400610954 with identifier: FT21371
2025-12-05 17:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb958ae2-5c6f-51da-b1e0-25d400610954 with scrape type 1
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_5da815b12dab44ae0f9e6b1381896a59.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_5da815b12dab44ae0f9e6b1381896a59.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_127bcb26a5758f2349c37413f9c4fea6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_127bcb26a5758f2349c37413f9c4fea6.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_6a7d837cf26a5f5ea48ea30ebb671700.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_6a7d837cf26a5f5ea48ea30ebb671700.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_55de6cf3227730ed4fd9aaee22527cd4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_55de6cf3227730ed4fd9aaee22527cd4.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_ee13f7ba4036e0a90efb3c8dcfd53ecb.png%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_ee13f7ba4036e0a90efb3c8dcfd53ecb.png not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_b791c041682b6edd202725e8b6b1148a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_b791c041682b6edd202725e8b6b1148a.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_2f7113bf2838e5d838210ad5f02d3f02.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_2f7113bf2838e5d838210ad5f02d3f02.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_06a2bb3cde2a8f44853f34a38a4a5b75.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_06a2bb3cde2a8f44853f34a38a4a5b75.jpg not downloaded yet
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_f0470c77748548f9df65fb9fa7b966c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_f0470c77748548f9df65fb9fa7b966c3.jpg not downloaded yet
2025-12-05 17:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM83713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_f0470c77748548f9df65fb9fa7b966c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_06a2bb3cde2a8f44853f34a38a4a5b75.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eed950>
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_f0470c77748548f9df65fb9fa7b966c3.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_f0470c77748548f9df65fb9fa7b966c3.jpg saved to cache
2025-12-05 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5881d10>
2025-12-05 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_06a2bb3cde2a8f44853f34a38a4a5b75.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_06a2bb3cde2a8f44853f34a38a4a5b75.jpg saved to cache
2025-12-05 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS94579> (referer: https://www.auto1.com/v1/car-details-view/XS94579/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_2f7113bf2838e5d838210ad5f02d3f02.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b35260c-0a11-5512-83e4-30ec9fb520cc with identifier: XS94579
2025-12-05 17:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b35260c-0a11-5512-83e4-30ec9fb520cc with scrape type 2
2025-12-05 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b35260c-0a11-5512-83e4-30ec9fb520cc with scrape type 2
2025-12-05 17:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b35260c-0a11-5512-83e4-30ec9fb520cc, identifier: XS94579
2025-12-05 17:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b35260c-0a11-5512-83e4-30ec9fb520cc with identifier: XS94579
2025-12-05 17:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b35260c-0a11-5512-83e4-30ec9fb520cc with identifier: XS94579
2025-12-05 17:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b35260c-0a11-5512-83e4-30ec9fb520cc with identifier: XS94579 to the API
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS94579>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 140,
'expiration_date': '2025-12-06T16:31:39Z',
'fuel_type': 'petrol',
'id': '8b35260c-0a11-5512-83e4-30ec9fb520cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS94579',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'BMW',
'model': '1er',
'odometer': 120000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS94579%27 HTTP/1.1" 200 None
2025-12-05 17:09:56 [auto1.fr] INFO: Saving data for XS94579: {'auction_closing_time': 1765038699.0, 'created_time': 1764583656.558664, 'last_price_update_time': 1764954596.682965}
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XS94579') HTTP/1.1" 204 0
2025-12-05 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_b791c041682b6edd202725e8b6b1148a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ29729> (referer: https://www.auto1.com/v1/car-details-view/XJ29729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE79287> (referer: https://www.auto1.com/v1/car-details-view/EE79287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eee290>
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_2f7113bf2838e5d838210ad5f02d3f02.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_2f7113bf2838e5d838210ad5f02d3f02.jpg saved to cache
2025-12-05 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cdf5d0>
2025-12-05 17:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_b791c041682b6edd202725e8b6b1148a.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_b791c041682b6edd202725e8b6b1148a.jpg saved to cache
2025-12-05 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 with identifier: XJ29729
2025-12-05 17:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 with scrape type 2
2025-12-05 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 with scrape type 2
2025-12-05 17:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0c00e3b9-ae76-54e1-abc6-7314ca772ca5, identifier: XJ29729
2025-12-05 17:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b4a3e1-4469-587b-ba56-e3ebd879e7c9 with identifier: EE79287
2025-12-05 17:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b4a3e1-4469-587b-ba56-e3ebd879e7c9 with scrape type 2
2025-12-05 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b4a3e1-4469-587b-ba56-e3ebd879e7c9 with scrape type 2
2025-12-05 17:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0b4a3e1-4469-587b-ba56-e3ebd879e7c9, identifier: EE79287
2025-12-05 17:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_ee13f7ba4036e0a90efb3c8dcfd53ecb.png> (referer: https://www.auto1.com/)
2025-12-05 17:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 with identifier: XJ29729
2025-12-05 17:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 with identifier: XJ29729
2025-12-05 17:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2025-12-05 17:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 spider: auto1.fr
2025-12-05 17:09:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0c00e3b9-ae76-54e1-abc6-7314ca772ca5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
'c_o_2_emission_value': 224,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:52:41Z',
'fuel_type': 'diesel',
'id': '0c00e3b9-ae76-54e1-abc6-7314ca772ca5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ29729',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Ford',
'model': 'Ranger',
'odometer': 47262,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Extrakabine 4x4 XLT',
'transmission': 'manual',
'trim': 'Extrakabine 4x4 XLT',
'year': 2022}
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ29729%27 HTTP/1.1" 200 None
2025-12-05 17:09:57 [auto1.fr] INFO: Saving data for XJ29729: {'auction_closing_time': 1765039961.0, 'created_time': 1762251403.447939, 'last_price_update_time': 1764954597.560305}
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XJ29729') HTTP/1.1" 204 0
2025-12-05 17:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0b4a3e1-4469-587b-ba56-e3ebd879e7c9 with identifier: EE79287
2025-12-05 17:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0b4a3e1-4469-587b-ba56-e3ebd879e7c9 with identifier: EE79287
2025-12-05 17:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b0b4a3e1-4469-587b-ba56-e3ebd879e7c9 with identifier: EE79287 to the API
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EE79287>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:08:26Z',
'fuel_type': 'diesel',
'id': 'b0b4a3e1-4469-587b-ba56-e3ebd879e7c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE79287',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 100164,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE79287%27 HTTP/1.1" 200 None
2025-12-05 17:09:57 [auto1.fr] INFO: Saving data for EE79287: {'auction_closing_time': 1765037306.0, 'created_time': 1763971312.162653, 'last_price_update_time': 1764954597.997707}
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE79287') HTTP/1.1" 204 0
2025-12-05 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_55de6cf3227730ed4fd9aaee22527cd4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_6a7d837cf26a5f5ea48ea30ebb671700.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK31452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 41 4
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: STREAM b'cHRM' 57 32
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: STREAM b'bKGD' 101 6
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: b'bKGD' 101 6 (unknown)
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: STREAM b'tIME' 119 7
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: b'tIME' 119 7 (unknown)
2025-12-05 17:09:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 138 32768
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d61710>
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_4.png HTTP/1.1" 201 0
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_ee13f7ba4036e0a90efb3c8dcfd53ecb.png') HTTP/1.1" 204 0
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_ee13f7ba4036e0a90efb3c8dcfd53ecb.png saved to cache
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_5da815b12dab44ae0f9e6b1381896a59.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5976990>
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_55de6cf3227730ed4fd9aaee22527cd4.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_55de6cf3227730ed4fd9aaee22527cd4.jpg saved to cache
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5781390>
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_6a7d837cf26a5f5ea48ea30ebb671700.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_6a7d837cf26a5f5ea48ea30ebb671700.jpg saved to cache
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5acb810>
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_5da815b12dab44ae0f9e6b1381896a59.jpg') HTTP/1.1" 204 0
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_5da815b12dab44ae0f9e6b1381896a59.jpg saved to cache
2025-12-05 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA76671> (referer: https://www.auto1.com/v1/car-details-view/UA76671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_127bcb26a5758f2349c37413f9c4fea6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c86a1804-3e8a-5e5d-be1d-60af62951928 with identifier: UA76671
2025-12-05 17:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c86a1804-3e8a-5e5d-be1d-60af62951928 with scrape type 2
2025-12-05 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c86a1804-3e8a-5e5d-be1d-60af62951928 with scrape type 2
2025-12-05 17:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c86a1804-3e8a-5e5d-be1d-60af62951928, identifier: UA76671
2025-12-05 17:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c86a1804-3e8a-5e5d-be1d-60af62951928 with identifier: UA76671
2025-12-05 17:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c86a1804-3e8a-5e5d-be1d-60af62951928 with identifier: UA76671
2025-12-05 17:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c86a1804-3e8a-5e5d-be1d-60af62951928 with identifier: UA76671 to the API
2025-12-05 17:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA76671>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2025-12-06T16:55:10Z',
'fuel_type': 'hybrid',
'id': 'c86a1804-3e8a-5e5d-be1d-60af62951928',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA76671',
'listing': 'auction',
'location': 'FR',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 89478,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x4 Business',
'transmission': 'automatic',
'trim': '4x4 Business',
'year': 2020}
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA76671%27 HTTP/1.1" 200 None
2025-12-05 17:10:00 [auto1.fr] INFO: Saving data for UA76671: {'auction_closing_time': 1765040110.0, 'created_time': 1764669849.328413, 'last_price_update_time': 1764954600.041593}
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA76671') HTTP/1.1" 204 0
2025-12-05 17:10:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c44990>
2025-12-05 17:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa3%252Fe6a323027b92f715edb947c3be0e0322%252Fpa%252FFT21371_127bcb26a5758f2349c37413f9c4fea6.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_127bcb26a5758f2349c37413f9c4fea6.jpg saved to cache
2025-12-05 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb958ae2-5c6f-51da-b1e0-25d400610954
2025-12-05 17:10:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb958ae2-5c6f-51da-b1e0-25d400610954, skipping ID generation
2025-12-05 17:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb958ae2-5c6f-51da-b1e0-25d400610954 with scrape type 1
2025-12-05 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb958ae2-5c6f-51da-b1e0-25d400610954 from tracking dictionaries
2025-12-05 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb958ae2-5c6f-51da-b1e0-25d400610954 sending to next pipeline
2025-12-05 17:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb958ae2-5c6f-51da-b1e0-25d400610954, identifier: FT21371
2025-12-05 17:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT88767> (referer: https://www.auto1.com/v1/car-details-view/LT88767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb958ae2-5c6f-51da-b1e0-25d400610954 with identifier: FT21371
2025-12-05 17:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb958ae2-5c6f-51da-b1e0-25d400610954 with identifier: FT21371
2025-12-05 17:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eb958ae2-5c6f-51da-b1e0-25d400610954 with identifier: FT21371 to the API
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_127bcb26a5758f2349c37413f9c4fea6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2025-12-06T16:51:52Z',
'fuel_type': 'hybrid',
'id': 'eb958ae2-5c6f-51da-b1e0-25d400610954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT21371',
'listing': 'auction',
'location': 'FR',
'make': 'Toyota',
'model': 'Prius',
'odometer': 92122,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_5da815b12dab44ae0f9e6b1381896a59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1149865,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_127bcb26a5758f2349c37413f9c4fea6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_6a7d837cf26a5f5ea48ea30ebb671700.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_55de6cf3227730ed4fd9aaee22527cd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 165757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_ee13f7ba4036e0a90efb3c8dcfd53ecb.png',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_b791c041682b6edd202725e8b6b1148a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_2f7113bf2838e5d838210ad5f02d3f02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_06a2bb3cde2a8f44853f34a38a4a5b75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb958ae2-5c6f-51da-b1e0-25d400610954/eb958ae2-5c6f-51da-b1e0-25d400610954_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/a3/e6a323027b92f715edb947c3be0e0322/pa/FT21371_f0470c77748548f9df65fb9fa7b966c3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Prius 1.8 Hybrid Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2020}
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT21371%27 HTTP/1.1" 200 None
2025-12-05 17:10:00 [auto1.fr] INFO: Saving data for FT21371: {'created_time': 1764954600.809573, 'last_price_update_time': 1764954600.809588, 'auction_closing_time': 1765039912.0}
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FT21371') HTTP/1.1" 204 0
2025-12-05 17:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5aebac-49df-5e0f-8043-ed66338a3903 with identifier: LT88767
2025-12-05 17:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5aebac-49df-5e0f-8043-ed66338a3903 with scrape type 2
2025-12-05 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5aebac-49df-5e0f-8043-ed66338a3903 with scrape type 2
2025-12-05 17:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e5aebac-49df-5e0f-8043-ed66338a3903, identifier: LT88767
2025-12-05 17:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e5aebac-49df-5e0f-8043-ed66338a3903 with identifier: LT88767
2025-12-05 17:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e5aebac-49df-5e0f-8043-ed66338a3903 with identifier: LT88767
2025-12-05 17:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e5aebac-49df-5e0f-8043-ed66338a3903 with identifier: LT88767 to the API
2025-12-05 17:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT88767>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2025-12-06T16:27:47Z',
'fuel_type': 'petrol',
'id': '9e5aebac-49df-5e0f-8043-ed66338a3903',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT88767',
'listing': 'auction',
'location': 'FR',
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 15194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-03',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2022}
2025-12-05 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT88767%27 HTTP/1.1" 200 None
2025-12-05 17:10:01 [auto1.fr] INFO: Saving data for LT88767: {'auction_closing_time': 1765038467.0, 'created_time': 1764669822.17499, 'last_price_update_time': 1764954601.239988}
2025-12-05 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LT88767') HTTP/1.1" 204 0
2025-12-05 17:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD79566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA35724/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM83713> (referer: https://www.auto1.com/v1/car-details-view/FM83713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3 with identifier: FM83713
2025-12-05 17:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3 with scrape type 2
2025-12-05 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3 with scrape type 2
2025-12-05 17:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3, identifier: FM83713
2025-12-05 17:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3 with identifier: FM83713
2025-12-05 17:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3 with identifier: FM83713
2025-12-05 17:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3 with identifier: FM83713 to the API
2025-12-05 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM83713>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:46:02Z',
'fuel_type': 'diesel',
'id': 'e14c6a0e-7c67-5ebf-ac0b-502f6d02e9e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM83713',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 121637,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition BlueMotion',
'transmission': 'manual',
'trim': 'Carat Edition BlueMotion',
'year': 2017}
2025-12-05 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM83713%27 HTTP/1.1" 200 None
2025-12-05 17:10:08 [auto1.fr] INFO: Saving data for FM83713: {'auction_closing_time': 1765039562.0, 'created_time': 1762509637.418165, 'last_price_update_time': 1764954608.302781}
2025-12-05 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM83713') HTTP/1.1" 204 0
2025-12-05 17:10:08 [scrapy.extensions.logstats] INFO: Crawled 754 pages (at 25 pages/min), scraped 183 items (at 14 items/min)
2025-12-05 17:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG14184/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK70717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD95067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM28318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:11 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: LD83766
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD83766%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for LD83766: 0
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: SW38104
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW38104%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for SW38104: 0
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: BX73985
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX73985%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for BX73985: 0
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: FW87176
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW87176%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for FW87176: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: ZX29888
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX29888%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for ZX29888: 1
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: BC70892
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC70892%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for BC70892: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: KP46513
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP46513%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for KP46513: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: WG90809
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG90809%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for WG90809: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: ZF22737
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF22737%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for ZF22737: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: LC31591
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC31591%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for LC31591: 1
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: JB21305
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB21305%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for JB21305: 1
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: SM43715
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM43715%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for SM43715: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: YJ88026
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ88026%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for YJ88026: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: PU89750
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU89750%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for PU89750: 1
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: GC29401
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC29401%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for GC29401: 1
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: TX17937
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX17937%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for TX17937: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: RE93344
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE93344%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for RE93344: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: XR77769
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR77769%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for XR77769: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: DJ35727
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ35727%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for DJ35727: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: BD41847
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD41847%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for BD41847: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: AK89791
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK89791%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for AK89791: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: TY38052
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY38052%27 HTTP/1.1" 200 None
2025-12-05 17:10:11 [auto1.fr] INFO: Scrape type for TY38052: 2
2025-12-05 17:10:11 [auto1.fr] INFO: Found listing with ID: LM28528
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM28528%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for LM28528: 2
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: KD25235
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD25235%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for KD25235: 2
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: PW42615
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW42615%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for PW42615: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: JP21503
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP21503%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for JP21503: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: HB93630
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB93630%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for HB93630: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: AD24281
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD24281%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for AD24281: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: TW69829
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW69829%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for TW69829: 2
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: AM97121
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM97121%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for AM97121: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: WW12651
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW12651%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for WW12651: 2
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: WM34990
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM34990%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for WM34990: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: AX52732
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX52732%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for AX52732: 2
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: BL88349
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL88349%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for BL88349: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: UC82355
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC82355%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for UC82355: 2
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: TJ24715
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ24715%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for TJ24715: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: CN16133
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN16133%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for CN16133: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: TY20003
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY20003%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for TY20003: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: RH90970
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH90970%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for RH90970: 1
2025-12-05 17:10:12 [auto1.fr] INFO: Found listing with ID: AN83141
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN83141%27 HTTP/1.1" 200 None
2025-12-05 17:10:12 [auto1.fr] INFO: Scrape type for AN83141: 1
2025-12-05 17:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG57630> (referer: https://www.auto1.com/v1/car-details-view/YG57630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9521edb3-2a29-5201-82b8-3c16d75182a7 with identifier: YG57630
2025-12-05 17:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9521edb3-2a29-5201-82b8-3c16d75182a7 with scrape type 1
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 9521edb3-2a29-5201-82b8-3c16d75182a7
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_b2898e08622838968232cdd8f931a40b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_b2898e08622838968232cdd8f931a40b.jpg already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_c0c9ce32cc666245aa70311ea9e22cbe.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_c0c9ce32cc666245aa70311ea9e22cbe.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_92db58960e2864a7878511e77a3ba275.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_92db58960e2864a7878511e77a3ba275.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_3471156de5036a494ba1ad48b5da2e0d.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_3471156de5036a494ba1ad48b5da2e0d.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_96d09a6e99b41e86ce230836390e5723.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_96d09a6e99b41e86ce230836390e5723.jpg already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_336b7217b4bb4d7220f70c6a1b987180.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_336b7217b4bb4d7220f70c6a1b987180.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_93380436fb72bb92bc1c93c221b34e6c.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_93380436fb72bb92bc1c93c221b34e6c.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_f76bd37af2560e24e6b5ae4684c6450a.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_f76bd37af2560e24e6b5ae4684c6450a.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_17f6e4b47fe242424daaa663c4808747.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_17f6e4b47fe242424daaa663c4808747.jpg already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_2637c61e5dc055e56408cbf9e708d27b.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_2637c61e5dc055e56408cbf9e708d27b.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_4fc8ed74701b4b033561630d016cc605.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_4fc8ed74701b4b033561630d016cc605.png already downloaded
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F99%252F6d997abf34d72e437f19aca267b5e5f4%252Fpa%252FYG57630_ea24789aa549c0c34bd1dc34166ea4be.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_ea24789aa549c0c34bd1dc34166ea4be.png already downloaded
2025-12-05 17:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9521edb3-2a29-5201-82b8-3c16d75182a7, identifier: YG57630
2025-12-05 17:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9521edb3-2a29-5201-82b8-3c16d75182a7 with identifier: YG57630
2025-12-05 17:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9521edb3-2a29-5201-82b8-3c16d75182a7 with identifier: YG57630
2025-12-05 17:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9521edb3-2a29-5201-82b8-3c16d75182a7 with identifier: YG57630 to the API
2025-12-05 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG57630>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:24:42Z',
'fuel_type': 'diesel',
'id': '9521edb3-2a29-5201-82b8-3c16d75182a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG57630',
'listing': 'auction',
'location': 'FR, Nanterre',
'make': 'DS Automobiles',
'model': 'DS3 Crossback',
'odometer': 97243,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_b2898e08622838968232cdd8f931a40b.jpg',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_c0c9ce32cc666245aa70311ea9e22cbe.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_92db58960e2864a7878511e77a3ba275.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_3471156de5036a494ba1ad48b5da2e0d.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_96d09a6e99b41e86ce230836390e5723.jpg',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_336b7217b4bb4d7220f70c6a1b987180.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_93380436fb72bb92bc1c93c221b34e6c.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_f76bd37af2560e24e6b5ae4684c6450a.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_17f6e4b47fe242424daaa663c4808747.jpg',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_2637c61e5dc055e56408cbf9e708d27b.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_4fc8ed74701b4b033561630d016cc605.png',
'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_ea24789aa549c0c34bd1dc34166ea4be.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399289,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_b2898e08622838968232cdd8f931a40b.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_c0c9ce32cc666245aa70311ea9e22cbe.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_92db58960e2864a7878511e77a3ba275.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_3471156de5036a494ba1ad48b5da2e0d.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293989,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_96d09a6e99b41e86ce230836390e5723.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_336b7217b4bb4d7220f70c6a1b987180.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_93380436fb72bb92bc1c93c221b34e6c.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_f76bd37af2560e24e6b5ae4684c6450a.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_17f6e4b47fe242424daaa663c4808747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_2637c61e5dc055e56408cbf9e708d27b.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_10.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_4fc8ed74701b4b033561630d016cc605.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9521edb3-2a29-5201-82b8-3c16d75182a7/9521edb3-2a29-5201-82b8-3c16d75182a7_image_11.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6d/99/6d997abf34d72e437f19aca267b5e5f4/pa/YG57630_ea24789aa549c0c34bd1dc34166ea4be.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS3 Crossback 1.5 Blue-HDi Chic',
'transmission': 'manual',
'trim': 'Chic',
'year': 2021}
2025-12-05 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG57630%27 HTTP/1.1" 200 None
2025-12-05 17:10:17 [auto1.fr] INFO: Saving data for YG57630: {'created_time': 1764954617.633783, 'last_price_update_time': 1764954617.633792, 'auction_closing_time': 1765038282.0}
2025-12-05 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG57630') HTTP/1.1" 204 0
2025-12-05 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL71607> (referer: https://www.auto1.com/v1/car-details-view/YL71607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 868fbfa4-db4e-5839-b701-91108484a6fd with identifier: YL71607
2025-12-05 17:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 868fbfa4-db4e-5839-b701-91108484a6fd with scrape type 2
2025-12-05 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 868fbfa4-db4e-5839-b701-91108484a6fd with scrape type 2
2025-12-05 17:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 868fbfa4-db4e-5839-b701-91108484a6fd, identifier: YL71607
2025-12-05 17:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 868fbfa4-db4e-5839-b701-91108484a6fd with identifier: YL71607
2025-12-05 17:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 868fbfa4-db4e-5839-b701-91108484a6fd with identifier: YL71607
2025-12-05 17:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 868fbfa4-db4e-5839-b701-91108484a6fd with identifier: YL71607 to the API
2025-12-05 17:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL71607>
{'auction_title': '',
'c_o_2_emission_value': 18,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 320,
'expiration_date': '2025-12-06T16:19:39Z',
'fuel_type': 'hybrid',
'id': '868fbfa4-db4e-5839-b701-91108484a6fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL71607',
'listing': 'auction',
'location': 'FR',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 88149,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2021}
2025-12-05 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL71607%27 HTTP/1.1" 200 None
2025-12-05 17:10:21 [auto1.fr] INFO: Saving data for YL71607: {'auction_closing_time': 1765037979.0, 'created_time': 1764669829.536141, 'last_price_update_time': 1764954621.161143}
2025-12-05 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL71607') HTTP/1.1" 204 0
2025-12-05 17:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU77399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW10494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.989(s), this was the 1st time calling it.
2025-12-05 17:10:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.8551067184614434 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP72171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA35724> (referer: https://www.auto1.com/v1/car-details-view/XA35724/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b71acce-b015-5874-b1ec-bda83078e0bc with identifier: XA35724
2025-12-05 17:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b71acce-b015-5874-b1ec-bda83078e0bc with scrape type 2
2025-12-05 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b71acce-b015-5874-b1ec-bda83078e0bc with scrape type 2
2025-12-05 17:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0b71acce-b015-5874-b1ec-bda83078e0bc, identifier: XA35724
2025-12-05 17:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0b71acce-b015-5874-b1ec-bda83078e0bc with identifier: XA35724
2025-12-05 17:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0b71acce-b015-5874-b1ec-bda83078e0bc with identifier: XA35724
2025-12-05 17:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0b71acce-b015-5874-b1ec-bda83078e0bc with identifier: XA35724 to the API
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XA35724>
{'auction_title': '',
'c_o_2_emission_value': 28,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:39:31Z',
'fuel_type': 'hybrid',
'id': '0b71acce-b015-5874-b1ec-bda83078e0bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA35724',
'listing': 'auction',
'location': 'FR',
'make': 'DS Automobiles',
'model': 'DS7',
'odometer': 53001,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Performance Line +',
'transmission': 'automatic',
'trim': '4x2 Performance Line +',
'year': 2023}
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA35724%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [auto1.fr] INFO: Saving data for XA35724: {'auction_closing_time': 1765039171.0, 'created_time': 1764669854.637646, 'last_price_update_time': 1764954638.296108}
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XA35724') HTTP/1.1" 204 0
2025-12-05 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX88622> (referer: https://www.auto1.com/v1/car-details-view/MX88622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG14184> (referer: https://www.auto1.com/v1/car-details-view/VG14184/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef52f3c8-1151-5645-98b9-adc5cbb33d4c with identifier: MX88622
2025-12-05 17:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c with scrape type 1
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg not downloaded yet
2025-12-05 17:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a0e23d7-a12b-577b-b3b0-2d579d24098f with identifier: VG14184
2025-12-05 17:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f with scrape type 1
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_ea320a08262f7d693de75b09bbc2d320.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_ea320a08262f7d693de75b09bbc2d320.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_0113b34d250e597e30ec82977adc744e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_0113b34d250e597e30ec82977adc744e.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_e0c0d25dadc7a94740bdd20b290ccc5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_e0c0d25dadc7a94740bdd20b290ccc5f.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_1561bc55c69b350189b398ceb3a4a644.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_29cf3d1ef457de7056f0882bbf9e63f0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_29cf3d1ef457de7056f0882bbf9e63f0.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_0ca59692d863653d1792212394246092.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_d573f4c4b7e55ae622b4f5d2d6649082.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_d573f4c4b7e55ae622b4f5d2d6649082.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_df79a92dd8746fcc74e08026af32662c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_df79a92dd8746fcc74e08026af32662c.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_416268df07286266b24f6ae2c1be9a44.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_fb24278c66e07154f24ed358b1da9c4b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_fb24278c66e07154f24ed358b1da9c4b.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_1172b2a6e558ad3e923f33431df414f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_1172b2a6e558ad3e923f33431df414f5.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_e1caf833771ba385b35007b24827a115.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_218f5e84f6ae21dfcdcb6949bab09262.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_218f5e84f6ae21dfcdcb6949bab09262.png not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_a007d94e8bbdb8277bc71c56970be393.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_6c091eee70f47ec53aabc99915a12435.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_321c363380354351a084209f2cadd4a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_09679020b24773df044a3712f9a0e51e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg not downloaded yet
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg not downloaded yet
2025-12-05 17:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK70717> (referer: https://www.auto1.com/v1/car-details-view/YK70717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f with identifier: YK70717
2025-12-05 17:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f with scrape type 1
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_92b212f9cb77affde078677cfbca7a4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_849d86b9d3bb30027051bec7a4370797.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_2672e2d715ca4bf7de86400af78018d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_d125784b29f5c98012eed3f93b23a92b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_39fdb259d39a147b0985f94b17047f2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_a05c1d4b6009e30a8332aa49327679d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_4612b0d5173f12e25e1f0feef62d895b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_664a88edd288646314bff164c89ab844.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_2dd0af827743541fc5d00f9bb4c68872.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg already downloaded
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2a%252Ff22af297b439474216e58e9313a6b8ea%252Fpa%252FYK70717_168a45d18ebb2e8574ec1677a8ae22b7.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png already downloaded
2025-12-05 17:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f, identifier: YK70717
2025-12-05 17:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f with identifier: YK70717
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2025-12-05 17:10:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f with identifier: YK70717
2025-12-05 17:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 17233, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yk70717', 'expiration_date': '2025-12-06t16:02:40z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '3a41bcd6-9d43-50e8-9e8b-2869afa47b3f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89849}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76125}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83924}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70817}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69212}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 42181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56654}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 65782}], 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 17233}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'green',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:02:40z',
'fuel_type': 'petrol',
'id': '3a41bcd6-9d43-50e8-9e8b-2869afa47b3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yk70717',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 17233,
'odometer_in_km': 17233,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 65782,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
2025-12-05 17:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f spider: auto1.fr
2025-12-05 17:10:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3a41bcd6-9d43-50e8-9e8b-2869afa47b3f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 17233, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yk70717', 'expiration_date': '2025-12-06t16:02:40z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg', 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '3a41bcd6-9d43-50e8-9e8b-2869afa47b3f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89849}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76125}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83924}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70817}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69212}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 42181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56654}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 65782}], 'current_year_diff': 2, 'age_in_months': 27, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 17233}
Failed validating None in schema:
False
On instance:
{'age_in_months': 27,
'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'green',
'currency': 'eur',
'current_year_diff': 2,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:02:40z',
'fuel_type': 'petrol',
'id': '3a41bcd6-9d43-50e8-9e8b-2869afa47b3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yk70717',
'listing': 'auction',
'location': 'fr, ingrandes sur vienne',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 17233,
'odometer_in_km': 17233,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 65782,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:02:40Z',
'fuel_type': 'petrol',
'id': '3a41bcd6-9d43-50e8-9e8b-2869afa47b3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK70717',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': '308',
'odometer': 17233,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg',
'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_f7eaf9504f6d1e8c43ed455fc907db04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_92b212f9cb77affde078677cfbca7a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_849d86b9d3bb30027051bec7a4370797.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2672e2d715ca4bf7de86400af78018d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_d125784b29f5c98012eed3f93b23a92b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_39fdb259d39a147b0985f94b17047f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a05c1d4b6009e30a8332aa49327679d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_a53d38e489e8cdc69338a2a0f80b7297.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4612b0d5173f12e25e1f0feef62d895b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_b8c0331e4fdd48488915ca198a7b4e61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_5761212fb63c5e9eb261b4c6d8efe883.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_bc5e8bafc34806074ea818457f8f9e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_664a88edd288646314bff164c89ab844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_4fb3e4e4693f4dfd4bfcc96f3ec2a147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_2dd0af827743541fc5d00f9bb4c68872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a41bcd6-9d43-50e8-9e8b-2869afa47b3f/3a41bcd6-9d43-50e8-9e8b-2869afa47b3f_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 65782,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/2a/f22af297b439474216e58e9313a6b8ea/pa/YK70717_168a45d18ebb2e8574ec1677a8ae22b7.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK70717%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [auto1.fr] INFO: Saving data for YK70717: {'created_time': 1764954640.08478, 'last_price_update_time': 1764954640.084791, 'auction_closing_time': 1765036960.0}
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YK70717') HTTP/1.1" 204 0
2025-12-05 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD95067> (referer: https://www.auto1.com/v1/car-details-view/DD95067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM28318> (referer: https://www.auto1.com/v1/car-details-view/KM28318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c5f90>
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg saved to cache
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d622d0>
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_09679020b24773df044a3712f9a0e51e.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg saved to cache
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41d211e-928c-5032-a3cb-0abd923a9a8e with identifier: DD95067
2025-12-05 17:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41d211e-928c-5032-a3cb-0abd923a9a8e with scrape type 1
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d41d211e-928c-5032-a3cb-0abd923a9a8e
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_59e8d4e268d514dde1fc7781c5081529.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_59e8d4e268d514dde1fc7781c5081529.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_a973828b4d9477ef7535f50de193f397.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a973828b4d9477ef7535f50de193f397.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_688ca4d2deba0cba68b782355e6fd416.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_688ca4d2deba0cba68b782355e6fd416.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_192e25c21ee66394a43d8c2ae872268a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_192e25c21ee66394a43d8c2ae872268a.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_ada9f22fb453c32a34abe5d6ca90ecd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_ada9f22fb453c32a34abe5d6ca90ecd3.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_dfd56f73c4851142d63e1d4a4ce1df31.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_dfd56f73c4851142d63e1d4a4ce1df31.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_0381f9bdc412e6ebace183002dc69cfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_0381f9bdc412e6ebace183002dc69cfa.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_211b65b66c03974c3d4e215539e53f9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_211b65b66c03974c3d4e215539e53f9b.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_86f855cb58cb7ea26001a19b800ae101.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_86f855cb58cb7ea26001a19b800ae101.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_cdf5f25a35d5e95e164c7e46792691e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_cdf5f25a35d5e95e164c7e46792691e1.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_d585a3652d22f0479767b8567833402e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_d585a3652d22f0479767b8567833402e.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_a048313c126c8c3472a4f9fe012d607b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a048313c126c8c3472a4f9fe012d607b.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_a6971755f2cca438665ba86443c3c0ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a6971755f2cca438665ba86443c3c0ad.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_f379e00a81d2b60a8a6fddf061f03d12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f379e00a81d2b60a8a6fddf061f03d12.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_f17745e45f54e4db8722120e8ee37601.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f17745e45f54e4db8722120e8ee37601.jpg already downloaded
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F2c%252F632c97da519baef98e45eb946c935614%252Fpa%252FDD95067_f75f228b82b13bee717c02af69b7ae74.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f75f228b82b13bee717c02af69b7ae74.png already downloaded
2025-12-05 17:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d41d211e-928c-5032-a3cb-0abd923a9a8e, identifier: DD95067
2025-12-05 17:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 with identifier: KM28318
2025-12-05 17:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 with scrape type 2
2025-12-05 17:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 with scrape type 2
2025-12-05 17:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a903455-db1c-5e5a-9a4d-c8a5b8603c54, identifier: KM28318
2025-12-05 17:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d41d211e-928c-5032-a3cb-0abd923a9a8e with identifier: DD95067
2025-12-05 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d41d211e-928c-5032-a3cb-0abd923a9a8e with identifier: DD95067
2025-12-05 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157780 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157780
2025-12-05 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d41d211e-928c-5032-a3cb-0abd923a9a8e spider: auto1.fr
2025-12-05 17:10:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d41d211e-928c-5032-a3cb-0abd923a9a8e due to rule: high_mileage_for_country.json, error: 157780 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157780
{'auction_title': '',
'c_o_2_emission_value': 86,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2025-12-06T16:31:43Z',
'fuel_type': 'hybrid',
'id': 'd41d211e-928c-5032-a3cb-0abd923a9a8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD95067',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 157780,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_59e8d4e268d514dde1fc7781c5081529.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a973828b4d9477ef7535f50de193f397.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_688ca4d2deba0cba68b782355e6fd416.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_192e25c21ee66394a43d8c2ae872268a.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_ada9f22fb453c32a34abe5d6ca90ecd3.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_dfd56f73c4851142d63e1d4a4ce1df31.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_0381f9bdc412e6ebace183002dc69cfa.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_211b65b66c03974c3d4e215539e53f9b.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_86f855cb58cb7ea26001a19b800ae101.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_cdf5f25a35d5e95e164c7e46792691e1.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_d585a3652d22f0479767b8567833402e.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a048313c126c8c3472a4f9fe012d607b.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a6971755f2cca438665ba86443c3c0ad.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f379e00a81d2b60a8a6fddf061f03d12.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f17745e45f54e4db8722120e8ee37601.jpg',
'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f75f228b82b13bee717c02af69b7ae74.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_59e8d4e268d514dde1fc7781c5081529.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3192783,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a973828b4d9477ef7535f50de193f397.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_688ca4d2deba0cba68b782355e6fd416.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_192e25c21ee66394a43d8c2ae872268a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_ada9f22fb453c32a34abe5d6ca90ecd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_dfd56f73c4851142d63e1d4a4ce1df31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_0381f9bdc412e6ebace183002dc69cfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_211b65b66c03974c3d4e215539e53f9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_86f855cb58cb7ea26001a19b800ae101.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_cdf5f25a35d5e95e164c7e46792691e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_d585a3652d22f0479767b8567833402e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a048313c126c8c3472a4f9fe012d607b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_a6971755f2cca438665ba86443c3c0ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f379e00a81d2b60a8a6fddf061f03d12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f17745e45f54e4db8722120e8ee37601.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41d211e-928c-5032-a3cb-0abd923a9a8e/d41d211e-928c-5032-a3cb-0abd923a9a8e_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 71856,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img63/2c/632c97da519baef98e45eb946c935614/pa/DD95067_f75f228b82b13bee717c02af69b7ae74.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2018}
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD95067%27 HTTP/1.1" 200 None
2025-12-05 17:10:41 [auto1.fr] INFO: Saving data for DD95067: {'created_time': 1764954641.324559, 'last_price_update_time': 1764954641.324568, 'auction_closing_time': 1765038703.0}
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD95067') HTTP/1.1" 204 0
2025-12-05 17:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 with identifier: KM28318
2025-12-05 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 with identifier: KM28318
2025-12-05 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 44569, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/km28318', 'expiration_date': '2025-12-06t16:06:45z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '4a903455-db1c-5e5a-9a4d-c8a5b8603c54', 'current_year_diff': 3, 'age_in_months': 40, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 44569}
Failed validating None in schema:
False
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:06:45z',
'fuel_type': 'petrol',
'id': '4a903455-db1c-5e5a-9a4d-c8a5b8603c54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/km28318',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'citroen',
'make_model': 'citroen c5 x',
'model': 'c5 x',
'odometer': 44569,
'odometer_in_km': 44569,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-28',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c5 x 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2022}
2025-12-05 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 spider: auto1.fr
2025-12-05 17:10:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a903455-db1c-5e5a-9a4d-c8a5b8603c54 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 44569, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/km28318', 'expiration_date': '2025-12-06t16:06:45z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '4a903455-db1c-5e5a-9a4d-c8a5b8603c54', 'current_year_diff': 3, 'age_in_months': 40, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 44569}
Failed validating None in schema:
False
On instance:
{'age_in_months': 40,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:06:45z',
'fuel_type': 'petrol',
'id': '4a903455-db1c-5e5a-9a4d-c8a5b8603c54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/km28318',
'listing': 'auction',
'location': 'fr, le boulou',
'make': 'citroen',
'make_model': 'citroen c5 x',
'model': 'c5 x',
'odometer': 44569,
'odometer_in_km': 44569,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-28',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c5 x 1.2 puretech shine',
'transmission': 'automatic',
'trim': 'shine',
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:06:45Z',
'fuel_type': 'petrol',
'id': '4a903455-db1c-5e5a-9a4d-c8a5b8603c54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM28318',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Citroen',
'model': 'C5 X',
'odometer': 44569,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 X 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2022}
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM28318%27 HTTP/1.1" 200 None
2025-12-05 17:10:41 [auto1.fr] INFO: Saving data for KM28318: {'auction_closing_time': 1765037205.0, 'created_time': 1763659087.587392, 'last_price_update_time': 1764954641.535031}
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KM28318') HTTP/1.1" 204 0
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN83141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD79566> (referer: https://www.auto1.com/v1/car-details-view/WD79566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_218f5e84f6ae21dfcdcb6949bab09262.png> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c48f50>
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg saved to cache
2025-12-05 17:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_1172b2a6e558ad3e923f33431df414f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1cd10>
2025-12-05 17:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_321c363380354351a084209f2cadd4a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg saved to cache
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58ddc10>
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_6c091eee70f47ec53aabc99915a12435.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg saved to cache
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8c0427b-b432-5994-bd13-a32631c42145 with identifier: WD79566
2025-12-05 17:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c0427b-b432-5994-bd13-a32631c42145 with scrape type 2
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8c0427b-b432-5994-bd13-a32631c42145 with scrape type 2
2025-12-05 17:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8c0427b-b432-5994-bd13-a32631c42145, identifier: WD79566
2025-12-05 17:10:42 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:10:42 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:10:42 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d03fd0>
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_8.png HTTP/1.1" 201 0
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_218f5e84f6ae21dfcdcb6949bab09262.png') HTTP/1.1" 204 0
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_218f5e84f6ae21dfcdcb6949bab09262.png saved to cache
2025-12-05 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8c0427b-b432-5994-bd13-a32631c42145 with identifier: WD79566
2025-12-05 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8c0427b-b432-5994-bd13-a32631c42145 with identifier: WD79566
2025-12-05 17:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a8c0427b-b432-5994-bd13-a32631c42145 with identifier: WD79566 to the API
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD79566>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2025-12-06T16:37:41Z',
'fuel_type': 'petrol',
'id': 'a8c0427b-b432-5994-bd13-a32631c42145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD79566',
'listing': 'auction',
'location': 'FR',
'make': 'Ford',
'model': 'Puma',
'odometer': 77694,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2021}
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD79566%27 HTTP/1.1" 200 None
2025-12-05 17:10:43 [auto1.fr] INFO: Saving data for WD79566: {'auction_closing_time': 1765039061.0, 'created_time': 1764669868.767257, 'last_price_update_time': 1764954643.084525}
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD79566') HTTP/1.1" 204 0
2025-12-05 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_fb24278c66e07154f24ed358b1da9c4b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_df79a92dd8746fcc74e08026af32662c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_d573f4c4b7e55ae622b4f5d2d6649082.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY20003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58dc310>
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg saved to cache
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c93ed0>
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_a007d94e8bbdb8277bc71c56970be393.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg saved to cache
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c588cc50>
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_1172b2a6e558ad3e923f33431df414f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_1172b2a6e558ad3e923f33431df414f5.jpg saved to cache
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cdf190>
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_e1caf833771ba385b35007b24827a115.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg saved to cache
2025-12-05 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c588f590>
2025-12-05 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg saved to cache
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_29cf3d1ef457de7056f0882bbf9e63f0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW10494> (referer: https://www.auto1.com/v1/car-details-view/EW10494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH90970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cdc750>
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_fb24278c66e07154f24ed358b1da9c4b.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_fb24278c66e07154f24ed358b1da9c4b.jpg saved to cache
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1e7d0>
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_416268df07286266b24f6ae2c1be9a44.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg saved to cache
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4efe810>
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_df79a92dd8746fcc74e08026af32662c.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_df79a92dd8746fcc74e08026af32662c.jpg saved to cache
2025-12-05 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e31fd0>
2025-12-05 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_d573f4c4b7e55ae622b4f5d2d6649082.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_d573f4c4b7e55ae622b4f5d2d6649082.jpg saved to cache
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585fb10>
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg saved to cache
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_e0c0d25dadc7a94740bdd20b290ccc5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU77399> (referer: https://www.auto1.com/v1/car-details-view/JU77399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d455d0>
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_29cf3d1ef457de7056f0882bbf9e63f0.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_29cf3d1ef457de7056f0882bbf9e63f0.jpg saved to cache
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58114d0>
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_0ca59692d863653d1792212394246092.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg saved to cache
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b035dddd-b995-507a-9890-346dd4d76f66 with identifier: EW10494
2025-12-05 17:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b035dddd-b995-507a-9890-346dd4d76f66 with scrape type 2
2025-12-05 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b035dddd-b995-507a-9890-346dd4d76f66 with scrape type 2
2025-12-05 17:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b035dddd-b995-507a-9890-346dd4d76f66, identifier: EW10494
2025-12-05 17:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b035dddd-b995-507a-9890-346dd4d76f66 with identifier: EW10494
2025-12-05 17:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b035dddd-b995-507a-9890-346dd4d76f66 with identifier: EW10494
2025-12-05 17:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 90564, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ew10494', 'expiration_date': '2025-12-06t16:08:43z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': 'b035dddd-b995-507a-9890-346dd4d76f66', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 90564}
Failed validating None in schema:
False
On instance:
{'age_in_months': 77,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:08:43z',
'fuel_type': 'petrol',
'id': 'b035dddd-b995-507a-9890-346dd4d76f66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ew10494',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 90564,
'odometer_in_km': 90564,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-11',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2019}
2025-12-05 17:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b035dddd-b995-507a-9890-346dd4d76f66 spider: auto1.fr
2025-12-05 17:10:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b035dddd-b995-507a-9890-346dd4d76f66 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 90564, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ew10494', 'expiration_date': '2025-12-06t16:08:43z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': 'b035dddd-b995-507a-9890-346dd4d76f66', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 90564}
Failed validating None in schema:
False
On instance:
{'age_in_months': 77,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:08:43z',
'fuel_type': 'petrol',
'id': 'b035dddd-b995-507a-9890-346dd4d76f66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ew10494',
'listing': 'auction',
'location': 'fr, ambarès-et-lagrave',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 90564,
'odometer_in_km': 90564,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-11',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 1.2 puretech shine',
'transmission': 'manual',
'trim': 'shine',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:08:43Z',
'fuel_type': 'petrol',
'id': 'b035dddd-b995-507a-9890-346dd4d76f66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW10494',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Citroen',
'model': 'C3',
'odometer': 90564,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW10494%27 HTTP/1.1" 200 None
2025-12-05 17:10:46 [auto1.fr] INFO: Saving data for EW10494: {'auction_closing_time': 1765037323.0, 'created_time': 1763658060.394683, 'last_price_update_time': 1764954646.229148}
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW10494') HTTP/1.1" 204 0
2025-12-05 17:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_0113b34d250e597e30ec82977adc744e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_ea320a08262f7d693de75b09bbc2d320.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK31452> (referer: https://www.auto1.com/v1/car-details-view/UK31452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5966010>
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_1561bc55c69b350189b398ceb3a4a644.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg saved to cache
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57773d0>
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_e0c0d25dadc7a94740bdd20b290ccc5f.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_e0c0d25dadc7a94740bdd20b290ccc5f.jpg saved to cache
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d12f10>
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg saved to cache
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7228599f-3c31-5f9e-b025-2e84de433ec9 with identifier: JU77399
2025-12-05 17:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7228599f-3c31-5f9e-b025-2e84de433ec9 with scrape type 2
2025-12-05 17:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7228599f-3c31-5f9e-b025-2e84de433ec9 with scrape type 2
2025-12-05 17:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7228599f-3c31-5f9e-b025-2e84de433ec9, identifier: JU77399
2025-12-05 17:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7228599f-3c31-5f9e-b025-2e84de433ec9 with identifier: JU77399
2025-12-05 17:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7228599f-3c31-5f9e-b025-2e84de433ec9 with identifier: JU77399
2025-12-05 17:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 74865, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ju77399', 'expiration_date': '2025-12-06t16:42:08z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 116, 'id': '7228599f-3c31-5f9e-b025-2e84de433ec9', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 74865}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:42:08z',
'fuel_type': 'petrol',
'id': '7228599f-3c31-5f9e-b025-2e84de433ec9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ju77399',
'listing': 'auction',
'location': 'fr, nanteuil-le-haudouin',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 74865,
'odometer_in_km': 74865,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2017}
2025-12-05 17:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7228599f-3c31-5f9e-b025-2e84de433ec9 spider: auto1.fr
2025-12-05 17:10:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7228599f-3c31-5f9e-b025-2e84de433ec9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 74865, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ju77399', 'expiration_date': '2025-12-06t16:42:08z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 116, 'id': '7228599f-3c31-5f9e-b025-2e84de433ec9', 'current_year_diff': 8, 'age_in_months': 98, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 74865}
Failed validating None in schema:
False
On instance:
{'age_in_months': 98,
'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:42:08z',
'fuel_type': 'petrol',
'id': '7228599f-3c31-5f9e-b025-2e84de433ec9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ju77399',
'listing': 'auction',
'location': 'fr, nanteuil-le-haudouin',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 74865,
'odometer_in_km': 74865,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech feel',
'transmission': 'manual',
'trim': 'feel',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:42:08Z',
'fuel_type': 'petrol',
'id': '7228599f-3c31-5f9e-b025-2e84de433ec9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU77399',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 74865,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2017}
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU77399%27 HTTP/1.1" 200 None
2025-12-05 17:10:47 [auto1.fr] INFO: Saving data for JU77399: {'auction_closing_time': 1765039328.0, 'created_time': 1764350202.636239, 'last_price_update_time': 1764954647.245325}
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU77399') HTTP/1.1" 204 0
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0c690>
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_0113b34d250e597e30ec82977adc744e.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_0113b34d250e597e30ec82977adc744e.jpg saved to cache
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9d190>
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F3d%252Ffc3d0af87943ae756764ab63b3a40b7e%252Fpa%252FVG14184_ea320a08262f7d693de75b09bbc2d320.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_ea320a08262f7d693de75b09bbc2d320.jpg saved to cache
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f
2025-12-05 17:10:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a0e23d7-a12b-577b-b3b0-2d579d24098f, skipping ID generation
2025-12-05 17:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f with scrape type 1
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6a0e23d7-a12b-577b-b3b0-2d579d24098f from tracking dictionaries
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a0e23d7-a12b-577b-b3b0-2d579d24098f sending to next pipeline
2025-12-05 17:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a0e23d7-a12b-577b-b3b0-2d579d24098f, identifier: VG14184
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f2110>
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg saved to cache
2025-12-05 17:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9f010>
2025-12-05 17:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F31%252Fc73138b5ace995db20d8b9c728a6b719%252Fpa%252FMX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg saved to cache
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c
2025-12-05 17:10:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef52f3c8-1151-5645-98b9-adc5cbb33d4c, skipping ID generation
2025-12-05 17:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c with scrape type 1
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef52f3c8-1151-5645-98b9-adc5cbb33d4c from tracking dictionaries
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef52f3c8-1151-5645-98b9-adc5cbb33d4c sending to next pipeline
2025-12-05 17:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef52f3c8-1151-5645-98b9-adc5cbb33d4c, identifier: MX88622
2025-12-05 17:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8dd750e-2877-531a-ba97-b4504a89b636 with identifier: UK31452
2025-12-05 17:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8dd750e-2877-531a-ba97-b4504a89b636 with scrape type 1
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d8dd750e-2877-531a-ba97-b4504a89b636
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_51d01097957952d0896a4229f22cf72f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_51d01097957952d0896a4229f22cf72f.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_32370246f6c7a1b4fc1338b5ee52349c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_32370246f6c7a1b4fc1338b5ee52349c.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_a5caf8a5a4c38bccfe1a834ecb5b3d32.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_a5caf8a5a4c38bccfe1a834ecb5b3d32.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_678b95c96efecbba20fbbf94002f3405.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_678b95c96efecbba20fbbf94002f3405.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_d67624d34ded6348ce93b7168b72b867.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_d67624d34ded6348ce93b7168b72b867.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_71e401af398f3629ddd38e91b514ad54.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_71e401af398f3629ddd38e91b514ad54.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_9dbb0e3247608358dd0e786861f0a415.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_9dbb0e3247608358dd0e786861f0a415.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_3f3e12b2b11422f9c94ac6e37f3bd724.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3f3e12b2b11422f9c94ac6e37f3bd724.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_1dba2590bb1dc9275b4b44039084c8eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_1dba2590bb1dc9275b4b44039084c8eb.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_387debce25579d513f592098e280a228.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_387debce25579d513f592098e280a228.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_6770e12cd4735cbd25c500edac9b172f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_6770e12cd4735cbd25c500edac9b172f.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_3b859b94cafd3645df56aa7e184b3dd6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3b859b94cafd3645df56aa7e184b3dd6.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_20e7c8991d4639ede97b953be0a8ba1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_20e7c8991d4639ede97b953be0a8ba1f.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_3f74a2cf7aec219161b544c6c440144c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3f74a2cf7aec219161b544c6c440144c.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_9982aa1b1f0bfeeb300356c32f52befc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_9982aa1b1f0bfeeb300356c32f52befc.jpg already downloaded
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F57%252Fda578ed93227bb813b00535d65521f7c%252Fpa%252FUK31452_0f76e4110f612c672c3e7142ffd97ff9.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_0f76e4110f612c672c3e7142ffd97ff9.png already downloaded
2025-12-05 17:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d8dd750e-2877-531a-ba97-b4504a89b636, identifier: UK31452
2025-12-05 17:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a0e23d7-a12b-577b-b3b0-2d579d24098f with identifier: VG14184
2025-12-05 17:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a0e23d7-a12b-577b-b3b0-2d579d24098f with identifier: VG14184
2025-12-05 17:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a0e23d7-a12b-577b-b3b0-2d579d24098f with identifier: VG14184 to the API
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_ea320a08262f7d693de75b09bbc2d320.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:20:44Z',
'fuel_type': 'diesel',
'id': '6a0e23d7-a12b-577b-b3b0-2d579d24098f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG14184',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 130738,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_ea320a08262f7d693de75b09bbc2d320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_0113b34d250e597e30ec82977adc744e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_e0c0d25dadc7a94740bdd20b290ccc5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_29cf3d1ef457de7056f0882bbf9e63f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_d573f4c4b7e55ae622b4f5d2d6649082.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_df79a92dd8746fcc74e08026af32662c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_fb24278c66e07154f24ed358b1da9c4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_1172b2a6e558ad3e923f33431df414f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a0e23d7-a12b-577b-b3b0-2d579d24098f/6a0e23d7-a12b-577b-b3b0-2d579d24098f_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/3d/fc3d0af87943ae756764ab63b3a40b7e/pa/VG14184_218f5e84f6ae21dfcdcb6949bab09262.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.5 CDTI Business Elegance',
'transmission': 'manual',
'trim': 'Business Elegance',
'year': 2022}
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG14184%27 HTTP/1.1" 200 None
2025-12-05 17:10:49 [auto1.fr] INFO: Saving data for VG14184: {'created_time': 1764954649.087158, 'last_price_update_time': 1764954649.087168, 'auction_closing_time': 1765038044.0}
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG14184') HTTP/1.1" 204 0
2025-12-05 17:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef52f3c8-1151-5645-98b9-adc5cbb33d4c with identifier: MX88622
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef52f3c8-1151-5645-98b9-adc5cbb33d4c with identifier: MX88622
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 128023, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx88622', 'expiration_date': '2025-12-06t16:29:42z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, sens', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': 'ef52f3c8-1151-5645-98b9-adc5cbb33d4c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88487}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60919}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78815}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81309}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57271}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85313}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86301}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54593}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71771}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48397}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 104988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72747}], 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 128023}
Failed validating None in schema:
False
On instance:
{'age_in_months': 104,
'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:29:42z',
'fuel_type': 'petrol',
'id': 'ef52f3c8-1151-5645-98b9-adc5cbb33d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx88622',
'listing': 'auction',
'location': 'fr, sens',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 128023,
'odometer_in_km': 128023,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-20',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech active',
'transmission': 'automatic',
'trim': 'active',
'year': 2017}
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ef52f3c8-1151-5645-98b9-adc5cbb33d4c spider: auto1.fr
2025-12-05 17:10:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ef52f3c8-1151-5645-98b9-adc5cbb33d4c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 128023, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx88622', 'expiration_date': '2025-12-06t16:29:42z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, sens', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': 'ef52f3c8-1151-5645-98b9-adc5cbb33d4c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 88487}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60919}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78815}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81309}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57271}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85313}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86301}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54593}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58237}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71771}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48397}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 104988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72747}], 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 128023}
Failed validating None in schema:
False
On instance:
{'age_in_months': 104,
'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:29:42z',
'fuel_type': 'petrol',
'id': 'ef52f3c8-1151-5645-98b9-adc5cbb33d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx88622',
'listing': 'auction',
'location': 'fr, sens',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 128023,
'odometer_in_km': 128023,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-20',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech active',
'transmission': 'automatic',
'trim': 'active',
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:29:42Z',
'fuel_type': 'petrol',
'id': 'ef52f3c8-1151-5645-98b9-adc5cbb33d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX88622',
'listing': 'auction',
'location': 'FR, Sens',
'make': 'Peugeot',
'model': '3008',
'odometer': 128023,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_5c39791ab10acfcec6ece7c32a3ed473.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_3f633ddbc38d88ebad3a7907fb16d738.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4c3f93f7d7b84ab052ec76798ff73fae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_1561bc55c69b350189b398ceb3a4a644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_0ca59692d863653d1792212394246092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_fa3cd123bf159d85c1fa36ce6f228e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_416268df07286266b24f6ae2c1be9a44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_4f83e18a8546e4a4c0aa1d764ce9786f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_e1caf833771ba385b35007b24827a115.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_9469c2e19ef7aecbf329761d654ad6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_a007d94e8bbdb8277bc71c56970be393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_d15d2b2ece63e71fccde75ab67a26ee7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6c091eee70f47ec53aabc99915a12435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_321c363380354351a084209f2cadd4a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_09679020b24773df044a3712f9a0e51e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef52f3c8-1151-5645-98b9-adc5cbb33d4c/ef52f3c8-1151-5645-98b9-adc5cbb33d4c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/31/c73138b5ace995db20d8b9c728a6b719/pa/MX88622_6b7019c1bb30a2ba6ab15bf519907ff5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2017}
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX88622%27 HTTP/1.1" 200 None
2025-12-05 17:10:49 [auto1.fr] INFO: Saving data for MX88622: {'created_time': 1764954649.312057, 'last_price_update_time': 1764954649.312065, 'auction_closing_time': 1765038582.0}
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MX88622') HTTP/1.1" 204 0
2025-12-05 17:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d8dd750e-2877-531a-ba97-b4504a89b636 with identifier: UK31452
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d8dd750e-2877-531a-ba97-b4504a89b636 with identifier: UK31452
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d8dd750e-2877-531a-ba97-b4504a89b636 spider: auto1.fr
2025-12-05 17:10:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d8dd750e-2877-531a-ba97-b4504a89b636 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:41:13Z',
'fuel_type': 'diesel',
'id': 'd8dd750e-2877-531a-ba97-b4504a89b636',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK31452',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 88220,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_51d01097957952d0896a4229f22cf72f.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_32370246f6c7a1b4fc1338b5ee52349c.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_a5caf8a5a4c38bccfe1a834ecb5b3d32.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_678b95c96efecbba20fbbf94002f3405.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_d67624d34ded6348ce93b7168b72b867.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_71e401af398f3629ddd38e91b514ad54.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_9dbb0e3247608358dd0e786861f0a415.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3f3e12b2b11422f9c94ac6e37f3bd724.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_1dba2590bb1dc9275b4b44039084c8eb.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_387debce25579d513f592098e280a228.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_6770e12cd4735cbd25c500edac9b172f.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3b859b94cafd3645df56aa7e184b3dd6.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_20e7c8991d4639ede97b953be0a8ba1f.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3f74a2cf7aec219161b544c6c440144c.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_9982aa1b1f0bfeeb300356c32f52befc.jpg',
'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_0f76e4110f612c672c3e7142ffd97ff9.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_51d01097957952d0896a4229f22cf72f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_32370246f6c7a1b4fc1338b5ee52349c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_a5caf8a5a4c38bccfe1a834ecb5b3d32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_678b95c96efecbba20fbbf94002f3405.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_d67624d34ded6348ce93b7168b72b867.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_71e401af398f3629ddd38e91b514ad54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_9dbb0e3247608358dd0e786861f0a415.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3f3e12b2b11422f9c94ac6e37f3bd724.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_1dba2590bb1dc9275b4b44039084c8eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_387debce25579d513f592098e280a228.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_6770e12cd4735cbd25c500edac9b172f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3b859b94cafd3645df56aa7e184b3dd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_20e7c8991d4639ede97b953be0a8ba1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465920,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_3f74a2cf7aec219161b544c6c440144c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_9982aa1b1f0bfeeb300356c32f52befc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8dd750e-2877-531a-ba97-b4504a89b636/d8dd750e-2877-531a-ba97-b4504a89b636_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 88847,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgda/57/da578ed93227bb813b00535d65521f7c/pa/UK31452_0f76e4110f612c672c3e7142ffd97ff9.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-09',
'seats_number': 3,
'seller_name': None,
'title': 'Peugeot Expert 1.6 Blue-HDi Premium Pack',
'transmission': 'manual',
'trim': 'Premium Pack',
'year': 2018}
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK31452%27 HTTP/1.1" 200 None
2025-12-05 17:10:49 [auto1.fr] INFO: Saving data for UK31452: {'created_time': 1764954649.597752, 'last_price_update_time': 1764954649.597761, 'auction_closing_time': 1765039273.0}
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK31452') HTTP/1.1" 204 0
2025-12-05 17:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ24715/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN16133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN83141> (referer: https://www.auto1.com/v1/car-details-view/AN83141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP72171> (referer: https://www.auto1.com/v1/car-details-view/DP72171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG03481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 with identifier: AN83141
2025-12-05 17:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 with scrape type 1
2025-12-05 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg not downloaded yet
2025-12-05 17:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c8cfe5-d3a3-5f8b-a340-1e28def287e3 with identifier: DP72171
2025-12-05 17:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c8cfe5-d3a3-5f8b-a340-1e28def287e3 with scrape type 2
2025-12-05 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c8cfe5-d3a3-5f8b-a340-1e28def287e3 with scrape type 2
2025-12-05 17:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99c8cfe5-d3a3-5f8b-a340-1e28def287e3, identifier: DP72171
2025-12-05 17:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99c8cfe5-d3a3-5f8b-a340-1e28def287e3 with identifier: DP72171
2025-12-05 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99c8cfe5-d3a3-5f8b-a340-1e28def287e3 with identifier: DP72171
2025-12-05 17:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99c8cfe5-d3a3-5f8b-a340-1e28def287e3 with identifier: DP72171 to the API
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP72171>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2025-12-06T16:30:26Z',
'fuel_type': 'diesel',
'id': '99c8cfe5-d3a3-5f8b-a340-1e28def287e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP72171',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 128522,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 2.0 CDTI Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2020}
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP72171%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [auto1.fr] INFO: Saving data for DP72171: {'auction_closing_time': 1765038626.0, 'created_time': 1763658537.724505, 'last_price_update_time': 1764954650.217359}
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP72171') HTTP/1.1" 204 0
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_5b45fc78ab905a9ea4d465040f4a04a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_5b45fc78ab905a9ea4d465040f4a04a1.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_f5ee6737947bb29f206010b361c5282c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f5ee6737947bb29f206010b361c5282c.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_68fae77aaf40a0ab895ef436ebfd6cb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_68fae77aaf40a0ab895ef436ebfd6cb0.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_901b6074289c0554b920492b390b98ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_901b6074289c0554b920492b390b98ad.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_e241ceb06028cf0468c8b2fc313ed844.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_e241ceb06028cf0468c8b2fc313ed844.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_8ff540d688ec09978c6c9407da319f76.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_8ff540d688ec09978c6c9407da319f76.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_eb1abbc6ace581a6b3cea31df25971d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_eb1abbc6ace581a6b3cea31df25971d5.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_f75c95016ce8a08febec9147932202ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f75c95016ce8a08febec9147932202ea.jpg not downloaded yet
2025-12-05 17:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY20003> (referer: https://www.auto1.com/v1/car-details-view/TY20003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_64781ed91601c62c392eea97c8ac42e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_64781ed91601c62c392eea97c8ac42e9.jpg not downloaded yet
2025-12-05 17:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_b30d30f1c204eb930557024336bc7f6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b30d30f1c204eb930557024336bc7f6d.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_905059f57f004d69c82c184d64828ed2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_905059f57f004d69c82c184d64828ed2.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_119f48754b64d5c091fcc193c53bfadc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_119f48754b64d5c091fcc193c53bfadc.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_d9f85d4fdf338620a3804ec80c6b74dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_d9f85d4fdf338620a3804ec80c6b74dd.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_41b44b2fb9dde8fc9b136fc408a30df2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_41b44b2fb9dde8fc9b136fc408a30df2.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_dae1f47f6cfbb58683022b5456d3e8bc.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_dae1f47f6cfbb58683022b5456d3e8bc.png not downloaded yet
2025-12-05 17:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f75c95016ce8a08febec9147932202ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a850c6c1-e1c0-599a-824f-fca4e47b57b7 with identifier: TY20003
2025-12-05 17:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a850c6c1-e1c0-599a-824f-fca4e47b57b7 with scrape type 1
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_55a01d59e895317f32917cab824dfa77.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg not downloaded yet
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_f2c096354afeadde1b7cb38d9f44514f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg not downloaded yet
2025-12-05 17:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_dae1f47f6cfbb58683022b5456d3e8bc.png> (referer: https://www.auto1.com/)
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7919410>
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_f75c95016ce8a08febec9147932202ea.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f75c95016ce8a08febec9147932202ea.jpg saved to cache
2025-12-05 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:10:50 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:10:50 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:10:50 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5899e10>
2025-12-05 17:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_15.png HTTP/1.1" 201 0
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_dae1f47f6cfbb58683022b5456d3e8bc.png') HTTP/1.1" 204 0
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_dae1f47f6cfbb58683022b5456d3e8bc.png saved to cache
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c91e90>
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_f2c096354afeadde1b7cb38d9f44514f.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg saved to cache
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC82355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fba10>
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_55a01d59e895317f32917cab824dfa77.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg saved to cache
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a84f90>
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg saved to cache
2025-12-05 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png> (referer: https://www.auto1.com/)
2025-12-05 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c79fd0>
2025-12-05 17:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg saved to cache
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_41b44b2fb9dde8fc9b136fc408a30df2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:52 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:10:52 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:10:52 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5971890>
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_2.png HTTP/1.1" 201 0
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png') HTTP/1.1" 204 0
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png saved to cache
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5e950>
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F2f%252F002f4c7f91724e89194121d86f7e6f75%252Fpa%252FTY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg saved to cache
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a850c6c1-e1c0-599a-824f-fca4e47b57b7
2025-12-05 17:10:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a850c6c1-e1c0-599a-824f-fca4e47b57b7, skipping ID generation
2025-12-05 17:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a850c6c1-e1c0-599a-824f-fca4e47b57b7 with scrape type 1
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a850c6c1-e1c0-599a-824f-fca4e47b57b7 from tracking dictionaries
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a850c6c1-e1c0-599a-824f-fca4e47b57b7 sending to next pipeline
2025-12-05 17:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a850c6c1-e1c0-599a-824f-fca4e47b57b7, identifier: TY20003
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f5e10>
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_41b44b2fb9dde8fc9b136fc408a30df2.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_41b44b2fb9dde8fc9b136fc408a30df2.jpg saved to cache
2025-12-05 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a850c6c1-e1c0-599a-824f-fca4e47b57b7 with identifier: TY20003
2025-12-05 17:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a850c6c1-e1c0-599a-824f-fca4e47b57b7 with identifier: TY20003
2025-12-05 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 6, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 148562, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty20003', 'expiration_date': '2025-12-06t16:30:41z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a850c6c1-e1c0-599a-824f-fca4e47b57b7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75342}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_2.png', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56804}], 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 148562}
Failed validating None in schema:
False
On instance:
{'age_in_months': 70,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:30:41z',
'fuel_type': 'petrol',
'id': 'a850c6c1-e1c0-599a-824f-fca4e47b57b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty20003',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 148562,
'odometer_in_km': 148562,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-02',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech active business',
'transmission': 'automatic',
'trim': 'active business',
'year': 2020}
2025-12-05 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a850c6c1-e1c0-599a-824f-fca4e47b57b7 spider: auto1.fr
2025-12-05 17:10:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a850c6c1-e1c0-599a-824f-fca4e47b57b7 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 6, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 148562, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty20003', 'expiration_date': '2025-12-06t16:30:41z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a850c6c1-e1c0-599a-824f-fca4e47b57b7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75342}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_2.png', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56804}], 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 148562}
Failed validating None in schema:
False
On instance:
{'age_in_months': 70,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:30:41z',
'fuel_type': 'petrol',
'id': 'a850c6c1-e1c0-599a-824f-fca4e47b57b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty20003',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 148562,
'odometer_in_km': 148562,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-02',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 1.2 puretech active business',
'transmission': 'automatic',
'trim': 'active business',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:30:41Z',
'fuel_type': 'petrol',
'id': 'a850c6c1-e1c0-599a-824f-fca4e47b57b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY20003',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '5008',
'odometer': 148562,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_7e1c10018061909ddf2dedb5a3c46e58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_351ca8e09a0c09cfc968d36cc7fa2f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_fb96ed8cb11c9b709ebfc1fd54a500ba.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_9aebeb5abb92b64ff15da23ba7f1da88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_55a01d59e895317f32917cab824dfa77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a850c6c1-e1c0-599a-824f-fca4e47b57b7/a850c6c1-e1c0-599a-824f-fca4e47b57b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/2f/002f4c7f91724e89194121d86f7e6f75/pa/TY20003_f2c096354afeadde1b7cb38d9f44514f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-02',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2020}
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY20003%27 HTTP/1.1" 200 None
2025-12-05 17:10:53 [auto1.fr] INFO: Saving data for TY20003: {'created_time': 1764954653.199155, 'last_price_update_time': 1764954653.199163, 'auction_closing_time': 1765038641.0}
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY20003') HTTP/1.1" 204 0
2025-12-05 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_d9f85d4fdf338620a3804ec80c6b74dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_119f48754b64d5c091fcc193c53bfadc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5898910>
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_d9f85d4fdf338620a3804ec80c6b74dd.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_d9f85d4fdf338620a3804ec80c6b74dd.jpg saved to cache
2025-12-05 17:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_905059f57f004d69c82c184d64828ed2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578f950>
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_119f48754b64d5c091fcc193c53bfadc.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_119f48754b64d5c091fcc193c53bfadc.jpg saved to cache
2025-12-05 17:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5898250>
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_905059f57f004d69c82c184d64828ed2.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_905059f57f004d69c82c184d64828ed2.jpg saved to cache
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b30d30f1c204eb930557024336bc7f6d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_64781ed91601c62c392eea97c8ac42e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b08190>
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_b30d30f1c204eb930557024336bc7f6d.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b30d30f1c204eb930557024336bc7f6d.jpg saved to cache
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_eb1abbc6ace581a6b3cea31df25971d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d3150>
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_64781ed91601c62c392eea97c8ac42e9.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_64781ed91601c62c392eea97c8ac42e9.jpg saved to cache
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_8ff540d688ec09978c6c9407da319f76.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5898410>
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_eb1abbc6ace581a6b3cea31df25971d5.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_eb1abbc6ace581a6b3cea31df25971d5.jpg saved to cache
2025-12-05 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e69010>
2025-12-05 17:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_8ff540d688ec09978c6c9407da319f76.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_8ff540d688ec09978c6c9407da319f76.jpg saved to cache
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_e241ceb06028cf0468c8b2fc313ed844.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL88349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_68fae77aaf40a0ab895ef436ebfd6cb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_901b6074289c0554b920492b390b98ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5965010>
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_e241ceb06028cf0468c8b2fc313ed844.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_e241ceb06028cf0468c8b2fc313ed844.jpg saved to cache
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_5b45fc78ab905a9ea4d465040f4a04a1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f5ee6737947bb29f206010b361c5282c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM97121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c587a850>
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_68fae77aaf40a0ab895ef436ebfd6cb0.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_68fae77aaf40a0ab895ef436ebfd6cb0.jpg saved to cache
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e48350>
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_901b6074289c0554b920492b390b98ad.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_901b6074289c0554b920492b390b98ad.jpg saved to cache
2025-12-05 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX52732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5878c10>
2025-12-05 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_5b45fc78ab905a9ea4d465040f4a04a1.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_5b45fc78ab905a9ea4d465040f4a04a1.jpg saved to cache
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfd150>
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_f5ee6737947bb29f206010b361c5282c.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f5ee6737947bb29f206010b361c5282c.jpg saved to cache
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e5f550>
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F1f%252F971faadd4419f137e8e5bfb78cca5d4d%252Fpa%252FAN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg') HTTP/1.1" 204 0
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg saved to cache
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0
2025-12-05 17:10:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0, skipping ID generation
2025-12-05 17:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 with scrape type 1
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 from tracking dictionaries
2025-12-05 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 sending to next pipeline
2025-12-05 17:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0, identifier: AN83141
2025-12-05 17:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 with identifier: AN83141
2025-12-05 17:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 with identifier: AN83141
2025-12-05 17:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0 with identifier: AN83141 to the API
2025-12-05 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:40:33Z',
'fuel_type': 'diesel',
'id': '30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN83141',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 123904,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b560fa1f4659eace0aa0f6c208d6a0e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_5b45fc78ab905a9ea4d465040f4a04a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f5ee6737947bb29f206010b361c5282c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_68fae77aaf40a0ab895ef436ebfd6cb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_901b6074289c0554b920492b390b98ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_e241ceb06028cf0468c8b2fc313ed844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_8ff540d688ec09978c6c9407da319f76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_eb1abbc6ace581a6b3cea31df25971d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_f75c95016ce8a08febec9147932202ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_64781ed91601c62c392eea97c8ac42e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_b30d30f1c204eb930557024336bc7f6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_905059f57f004d69c82c184d64828ed2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_119f48754b64d5c091fcc193c53bfadc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_d9f85d4fdf338620a3804ec80c6b74dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_41b44b2fb9dde8fc9b136fc408a30df2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0/30990ea4-bf19-51b5-a5c1-0a2f7eaa42f0_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 106231,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img97/1f/971faadd4419f137e8e5bfb78cca5d4d/pa/AN83141_dae1f47f6cfbb58683022b5456d3e8bc.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Inspiration',
'transmission': 'automatic',
'trim': 'Inspiration',
'year': 2017}
2025-12-05 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN83141%27 HTTP/1.1" 200 None
2025-12-05 17:10:57 [auto1.fr] INFO: Saving data for AN83141: {'created_time': 1764954657.227699, 'last_price_update_time': 1764954657.227717, 'auction_closing_time': 1765039233.0}
2025-12-05 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AN83141') HTTP/1.1" 204 0
2025-12-05 17:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD24281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB93630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW69829/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP21503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW42615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD25235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC82355> (referer: https://www.auto1.com/v1/car-details-view/UC82355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5abe165d-9f04-5e0a-92da-2d72f70a538a with identifier: UC82355
2025-12-05 17:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5abe165d-9f04-5e0a-92da-2d72f70a538a with scrape type 2
2025-12-05 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5abe165d-9f04-5e0a-92da-2d72f70a538a with scrape type 2
2025-12-05 17:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5abe165d-9f04-5e0a-92da-2d72f70a538a, identifier: UC82355
2025-12-05 17:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5abe165d-9f04-5e0a-92da-2d72f70a538a with identifier: UC82355
2025-12-05 17:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5abe165d-9f04-5e0a-92da-2d72f70a538a with identifier: UC82355
2025-12-05 17:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 63530, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc82355', 'expiration_date': '2025-12-06t16:15:48z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mougins', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '5abe165d-9f04-5e0a-92da-2d72f70a538a', 'current_year_diff': 5, 'age_in_months': 62, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63530}
Failed validating None in schema:
False
On instance:
{'age_in_months': 62,
'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:15:48z',
'fuel_type': 'petrol',
'id': '5abe165d-9f04-5e0a-92da-2d72f70a538a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc82355',
'listing': 'auction',
'location': 'fr, mougins',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 63530,
'odometer_in_km': 63530,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-21',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt line',
'transmission': 'manual',
'trim': 'gt line',
'year': 2020}
2025-12-05 17:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5abe165d-9f04-5e0a-92da-2d72f70a538a spider: auto1.fr
2025-12-05 17:11:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5abe165d-9f04-5e0a-92da-2d72f70a538a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 63530, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc82355', 'expiration_date': '2025-12-06t16:15:48z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mougins', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '5abe165d-9f04-5e0a-92da-2d72f70a538a', 'current_year_diff': 5, 'age_in_months': 62, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63530}
Failed validating None in schema:
False
On instance:
{'age_in_months': 62,
'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:15:48z',
'fuel_type': 'petrol',
'id': '5abe165d-9f04-5e0a-92da-2d72f70a538a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc82355',
'listing': 'auction',
'location': 'fr, mougins',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 63530,
'odometer_in_km': 63530,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-21',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech gt line',
'transmission': 'manual',
'trim': 'gt line',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:15:48Z',
'fuel_type': 'petrol',
'id': '5abe165d-9f04-5e0a-92da-2d72f70a538a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC82355',
'listing': 'auction',
'location': 'FR, MOUGINS',
'make': 'Peugeot',
'model': '2008',
'odometer': 63530,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2020}
2025-12-05 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC82355%27 HTTP/1.1" 200 None
2025-12-05 17:11:00 [auto1.fr] INFO: Saving data for UC82355: {'auction_closing_time': 1765037748.0, 'created_time': 1763658850.273455, 'last_price_update_time': 1764954660.460934}
2025-12-05 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC82355') HTTP/1.1" 204 0
2025-12-05 17:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL88349> (referer: https://www.auto1.com/v1/car-details-view/BL88349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM34990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e447d18-6f33-5d8b-8183-0c3097a5cdec with identifier: BL88349
2025-12-05 17:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e447d18-6f33-5d8b-8183-0c3097a5cdec with scrape type 1
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0e447d18-6f33-5d8b-8183-0c3097a5cdec
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_a06428ed990be68cb9a0b67426d6629c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_8a81cc173614df447e93d553b9bb2129.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_566eea04da1f8c77aaa18310fd5f911c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_6e84d6008cafff59fa0444c100e14b8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_7846da91a7ebac6a7726fdc4655807cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_b2e96cf6d13fea568e51740e61df0d98.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_1d128599d01d8b4589971085f7f274ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_4001979ec1cb9d79ff651563f87ab060.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_217c9f19d87cab142ff55e1d6f707619.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_d1527441eee43a386ca60d742986f916.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_7aa98bfebf525f4725a84bba944677a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F76%252F2476f16e5c9db6709a635e21874e3510%252Fpa%252FBL88349_29fa775e617a1f4f4c19ca76e513f6c6.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png already downloaded
2025-12-05 17:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e447d18-6f33-5d8b-8183-0c3097a5cdec, identifier: BL88349
2025-12-05 17:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e447d18-6f33-5d8b-8183-0c3097a5cdec with identifier: BL88349
2025-12-05 17:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e447d18-6f33-5d8b-8183-0c3097a5cdec with identifier: BL88349
2025-12-05 17:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 e-thp shine business', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 120913, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bl88349', 'expiration_date': '2025-12-06t16:41:36z', 'origin_country_code': 'fr', 'trim': 'shine business', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png'], 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'pau', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '0e447d18-6f33-5d8b-8183-0c3097a5cdec', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60089}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64062}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65315}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54083}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54391}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64015}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63753}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59508}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67411}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94323}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 84607}], 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 120913}
Failed validating None in schema:
False
On instance:
{'age_in_months': 92,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:41:36z',
'fuel_type': 'petrol',
'id': '0e447d18-6f33-5d8b-8183-0c3097a5cdec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bl88349',
'listing': 'auction',
'location': 'pau',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 120913,
'odometer_in_km': 120913,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 84607,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-22',
'sanitized_make': 'citroen',
'seats_number': 2,
'seller_name': None,
'title': 'citroen c3 1.2 e-thp shine business',
'transmission': 'automatic',
'trim': 'shine business',
'year': 2018}
2025-12-05 17:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0e447d18-6f33-5d8b-8183-0c3097a5cdec spider: auto1.fr
2025-12-05 17:11:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0e447d18-6f33-5d8b-8183-0c3097a5cdec due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 e-thp shine business', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 120913, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bl88349', 'expiration_date': '2025-12-06t16:41:36z', 'origin_country_code': 'fr', 'trim': 'shine business', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg', 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png'], 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'pau', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '0e447d18-6f33-5d8b-8183-0c3097a5cdec', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60089}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64062}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65315}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54083}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54391}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64015}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63753}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59508}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67411}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 94323}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 84607}], 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 120913}
Failed validating None in schema:
False
On instance:
{'age_in_months': 92,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:41:36z',
'fuel_type': 'petrol',
'id': '0e447d18-6f33-5d8b-8183-0c3097a5cdec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bl88349',
'listing': 'auction',
'location': 'pau',
'make': 'citroen',
'make_model': 'citroen c3',
'model': 'c3',
'odometer': 120913,
'odometer_in_km': 120913,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 84607,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-22',
'sanitized_make': 'citroen',
'seats_number': 2,
'seller_name': None,
'title': 'citroen c3 1.2 e-thp shine business',
'transmission': 'automatic',
'trim': 'shine business',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:41:36Z',
'fuel_type': 'petrol',
'id': '0e447d18-6f33-5d8b-8183-0c3097a5cdec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL88349',
'listing': 'auction',
'location': 'Pau',
'make': 'Citroen',
'model': 'C3',
'odometer': 120913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg',
'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_a06428ed990be68cb9a0b67426d6629c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_c8011e39cd1aee9eaa4a8f0c4914431a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_8a81cc173614df447e93d553b9bb2129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_566eea04da1f8c77aaa18310fd5f911c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_aac5396df9071ebdcde78d9be2e0b2fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6e84d6008cafff59fa0444c100e14b8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7846da91a7ebac6a7726fdc4655807cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_b2e96cf6d13fea568e51740e61df0d98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_6733ce5f5506716c3077cb75c3d3e5cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_1d128599d01d8b4589971085f7f274ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_4001979ec1cb9d79ff651563f87ab060.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_217c9f19d87cab142ff55e1d6f707619.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_d1527441eee43a386ca60d742986f916.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_7aa98bfebf525f4725a84bba944677a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_17fc3975c6238dd7786bce17b2dbf6d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e447d18-6f33-5d8b-8183-0c3097a5cdec/0e447d18-6f33-5d8b-8183-0c3097a5cdec_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 84607,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img24/76/2476f16e5c9db6709a635e21874e3510/pa/BL88349_29fa775e617a1f4f4c19ca76e513f6c6.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-22',
'seats_number': 2,
'seller_name': None,
'title': 'Citroen C3 1.2 e-THP Shine Business',
'transmission': 'automatic',
'trim': 'Shine Business',
'year': 2018}
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL88349%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [auto1.fr] INFO: Saving data for BL88349: {'created_time': 1764954662.711746, 'last_price_update_time': 1764954662.711755, 'auction_closing_time': 1765039296.0}
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BL88349') HTTP/1.1" 204 0
2025-12-05 17:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN16133> (referer: https://www.auto1.com/v1/car-details-view/CN16133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01dd627a-ad5f-54db-864c-fa0d446564c4 with identifier: CN16133
2025-12-05 17:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01dd627a-ad5f-54db-864c-fa0d446564c4 with scrape type 1
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 01dd627a-ad5f-54db-864c-fa0d446564c4
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_4fe2dd1b9f7f4c8b2f8b4cb0509a8af9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_4fe2dd1b9f7f4c8b2f8b4cb0509a8af9.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_86ee6f9b8c46a8b965099d32c6aabdf0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_86ee6f9b8c46a8b965099d32c6aabdf0.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_178a9a8833131c2bafac28c352c3e537.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_178a9a8833131c2bafac28c352c3e537.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_021ad1ac68fc49e33a06ad078d1a3b19.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_021ad1ac68fc49e33a06ad078d1a3b19.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_e4a65f5fd31f5ed0be74682c96a067cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_e4a65f5fd31f5ed0be74682c96a067cc.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_5e8dcaf0e77e0ddb88efb0d1214e9047.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_5e8dcaf0e77e0ddb88efb0d1214e9047.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_c33ce1fc97a54eddc5edd49d4df37e88.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_c33ce1fc97a54eddc5edd49d4df37e88.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_022f589461c0efb0b90480c3aab8fd2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_022f589461c0efb0b90480c3aab8fd2e.jpg already downloaded
2025-12-05 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_d307ccddd32ce9b310f3eac062803bfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_d307ccddd32ce9b310f3eac062803bfa.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_45b36201acf5efb6d2ccad5dad84e298.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_45b36201acf5efb6d2ccad5dad84e298.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_d1a569f80f2a7da207f10df73788d6a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_d1a569f80f2a7da207f10df73788d6a6.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_7c343b9ce4e319509fad6cd970d8fff6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_7c343b9ce4e319509fad6cd970d8fff6.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_08e96876ec874cf5b9553286fe0966ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_08e96876ec874cf5b9553286fe0966ed.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_30c635489b7289cd94e90edaf43b6d03.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_30c635489b7289cd94e90edaf43b6d03.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_132c8e81e12edd8548956e8189366a1c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_132c8e81e12edd8548956e8189366a1c.jpg already downloaded
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F85%252Fc6858b664e41214c5f7c959c98560a3c%252Fpa%252FCN16133_a7ff17bc8b70151a61c974aa556a311e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_a7ff17bc8b70151a61c974aa556a311e.jpg already downloaded
2025-12-05 17:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 01dd627a-ad5f-54db-864c-fa0d446564c4, identifier: CN16133
2025-12-05 17:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 01dd627a-ad5f-54db-864c-fa0d446564c4 with identifier: CN16133
2025-12-05 17:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 01dd627a-ad5f-54db-864c-fa0d446564c4 with identifier: CN16133
2025-12-05 17:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 01dd627a-ad5f-54db-864c-fa0d446564c4 with identifier: CN16133 to the API
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN16133>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2025-12-06T16:02:09Z',
'fuel_type': 'petrol',
'id': '01dd627a-ad5f-54db-864c-fa0d446564c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN16133',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Ford',
'model': 'Focus',
'odometer': 70127,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_4fe2dd1b9f7f4c8b2f8b4cb0509a8af9.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_86ee6f9b8c46a8b965099d32c6aabdf0.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_178a9a8833131c2bafac28c352c3e537.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_021ad1ac68fc49e33a06ad078d1a3b19.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_e4a65f5fd31f5ed0be74682c96a067cc.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_5e8dcaf0e77e0ddb88efb0d1214e9047.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_c33ce1fc97a54eddc5edd49d4df37e88.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_022f589461c0efb0b90480c3aab8fd2e.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_d307ccddd32ce9b310f3eac062803bfa.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_45b36201acf5efb6d2ccad5dad84e298.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_d1a569f80f2a7da207f10df73788d6a6.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_7c343b9ce4e319509fad6cd970d8fff6.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_08e96876ec874cf5b9553286fe0966ed.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_30c635489b7289cd94e90edaf43b6d03.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_132c8e81e12edd8548956e8189366a1c.jpg',
'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_a7ff17bc8b70151a61c974aa556a311e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_4fe2dd1b9f7f4c8b2f8b4cb0509a8af9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_86ee6f9b8c46a8b965099d32c6aabdf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_178a9a8833131c2bafac28c352c3e537.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_021ad1ac68fc49e33a06ad078d1a3b19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_e4a65f5fd31f5ed0be74682c96a067cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_5e8dcaf0e77e0ddb88efb0d1214e9047.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_c33ce1fc97a54eddc5edd49d4df37e88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_022f589461c0efb0b90480c3aab8fd2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_d307ccddd32ce9b310f3eac062803bfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_45b36201acf5efb6d2ccad5dad84e298.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_d1a569f80f2a7da207f10df73788d6a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_7c343b9ce4e319509fad6cd970d8fff6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_08e96876ec874cf5b9553286fe0966ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_30c635489b7289cd94e90edaf43b6d03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_132c8e81e12edd8548956e8189366a1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dd627a-ad5f-54db-864c-fa0d446564c4/01dd627a-ad5f-54db-864c-fa0d446564c4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/85/c6858b664e41214c5f7c959c98560a3c/pa/CN16133_a7ff17bc8b70151a61c974aa556a311e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN16133%27 HTTP/1.1" 200 None
2025-12-05 17:11:03 [auto1.fr] INFO: Saving data for CN16133: {'created_time': 1764954663.520751, 'last_price_update_time': 1764954663.520765, 'auction_closing_time': 1765036929.0}
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CN16133') HTTP/1.1" 204 0
2025-12-05 17:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX52732> (referer: https://www.auto1.com/v1/car-details-view/AX52732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG03481> (referer: https://www.auto1.com/v1/car-details-view/ZG03481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c509e4fc-612d-5d94-8fc8-7748844d60d5 with identifier: AX52732
2025-12-05 17:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c509e4fc-612d-5d94-8fc8-7748844d60d5 with scrape type 2
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c509e4fc-612d-5d94-8fc8-7748844d60d5 with scrape type 2
2025-12-05 17:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c509e4fc-612d-5d94-8fc8-7748844d60d5, identifier: AX52732
2025-12-05 17:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c509e4fc-612d-5d94-8fc8-7748844d60d5 with identifier: AX52732
2025-12-05 17:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c509e4fc-612d-5d94-8fc8-7748844d60d5 with identifier: AX52732
2025-12-05 17:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c509e4fc-612d-5d94-8fc8-7748844d60d5 with identifier: AX52732 to the API
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AX52732>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 107,
'expiration_date': '2025-12-06T16:19:58Z',
'fuel_type': 'diesel',
'id': 'c509e4fc-612d-5d94-8fc8-7748844d60d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX52732',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Dacia',
'model': 'Duster',
'odometer': 87715,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2016}
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX52732%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [auto1.fr] INFO: Saving data for AX52732: {'auction_closing_time': 1765037998.0, 'created_time': 1764237813.495561, 'last_price_update_time': 1764954664.883209}
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX52732') HTTP/1.1" 204 0
2025-12-05 17:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB12713> (referer: https://www.auto1.com/v1/car-details-view/GB12713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD24281> (referer: https://www.auto1.com/v1/car-details-view/AD24281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dea6c1e-d272-5031-9765-f184907e6a07 with identifier: ZG03481
2025-12-05 17:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dea6c1e-d272-5031-9765-f184907e6a07 with scrape type 1
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_f8ef2a9b71551bf63276afdc1a426531.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f8ef2a9b71551bf63276afdc1a426531.jpg not downloaded yet
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_3f54343a3b63b44e95d163290e8d64de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_3f54343a3b63b44e95d163290e8d64de.jpg not downloaded yet
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_6d0f9abed15498cedb946164fefb299d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6d0f9abed15498cedb946164fefb299d.jpg not downloaded yet
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_8bf4ecc002eb4325b3048a6e50b59945.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_8bf4ecc002eb4325b3048a6e50b59945.jpg not downloaded yet
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_2f55f67ed2bc654c248625bc955c96b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_2f55f67ed2bc654c248625bc955c96b9.jpg not downloaded yet
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_f3df74d7bab773ec37ac2b287b4359f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f3df74d7bab773ec37ac2b287b4359f2.jpg not downloaded yet
2025-12-05 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_a7f16300e6b5ddb3e3d7a084d175a073.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_a7f16300e6b5ddb3e3d7a084d175a073.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_e289a22e8c1e6909bd92d6793191d448.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_e289a22e8c1e6909bd92d6793191d448.jpg not downloaded yet
2025-12-05 17:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1096274-749d-51c6-8126-96e1bf7a592e with identifier: GB12713
2025-12-05 17:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1096274-749d-51c6-8126-96e1bf7a592e with scrape type 1
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item a1096274-749d-51c6-8126-96e1bf7a592e
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_00b84e39f3bb964f08b7b43f9f81caca.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_ff94e8e993755f1345aedaff904b7a64.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_ced342cd98697453d4e1034d245349cb.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_cc7b578fbb1102f806f17e9106582e3e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_964139525d72fcb4fe83fab7114f2ffe.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_afbdb00c6c321ec42a2b1e2325649700.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_db27fd35a812f1acdf2a470e383240cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_6484b1a621d9cfa815dc67756db189d6.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png already downloaded
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa597ba4ff7b8ed6d3c4bfca994ef2a%252Fpa%252FGB12713_796949f37eda795448a290079681a659.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png already downloaded
2025-12-05 17:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1096274-749d-51c6-8126-96e1bf7a592e, identifier: GB12713
2025-12-05 17:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b991d255-54c9-5fb4-8d7c-3ac507cc17b4 with identifier: AD24281
2025-12-05 17:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4 with scrape type 1
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_c2ea34db11ad9aeca93199131d7f4e47.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_c2ea34db11ad9aeca93199131d7f4e47.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_fb07cdce8f0d444649240cd746eb0056.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_fb07cdce8f0d444649240cd746eb0056.jpg not downloaded yet
2025-12-05 17:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1096274-749d-51c6-8126-96e1bf7a592e with identifier: GB12713
2025-12-05 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1096274-749d-51c6-8126-96e1bf7a592e with identifier: GB12713
2025-12-05 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 12, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 55755, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gb12713', 'expiration_date': '2025-12-06t16:14:10z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png'], 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, valenton', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a1096274-749d-51c6-8126-96e1bf7a592e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_0.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_1.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_2.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_3.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 341006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 119738}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_6.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_7.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_8.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 89465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_10.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_11.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 55755}
Failed validating None in schema:
False
On instance:
{'age_in_months': 48,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:14:10z',
'fuel_type': 'petrol',
'id': 'a1096274-749d-51c6-8126-96e1bf7a592e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gb12713',
'listing': 'auction',
'location': 'fr, valenton',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 55755,
'odometer_in_km': 55755,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341006,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89465,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_10.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_11.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-17',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
2025-12-05 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a1096274-749d-51c6-8126-96e1bf7a592e spider: auto1.fr
2025-12-05 17:11:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a1096274-749d-51c6-8126-96e1bf7a592e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 12, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 55755, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gb12713', 'expiration_date': '2025-12-06t16:14:10z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png', 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png'], 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, valenton', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a1096274-749d-51c6-8126-96e1bf7a592e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_0.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_1.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_2.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_3.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 341006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 119738}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_6.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_7.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_8.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 89465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_10.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 180722}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_11.png', 'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png', 'Width': 512, 'Height': 512, 'Extension': 'png', 'FileSizeInBytes': 153321}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 55755}
Failed validating None in schema:
False
On instance:
{'age_in_months': 48,
'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:14:10z',
'fuel_type': 'petrol',
'id': 'a1096274-749d-51c6-8126-96e1bf7a592e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gb12713',
'listing': 'auction',
'location': 'fr, valenton',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 55755,
'odometer_in_km': 55755,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341006,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89465,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_10.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_11.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-17',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:14:10Z',
'fuel_type': 'petrol',
'id': 'a1096274-749d-51c6-8126-96e1bf7a592e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB12713',
'listing': 'auction',
'location': 'FR, Valenton',
'make': 'Peugeot',
'model': '208',
'odometer': 55755,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png',
'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_00b84e39f3bb964f08b7b43f9f81caca.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ff94e8e993755f1345aedaff904b7a64.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ceb94fcc5e3d5cf91f9436cc0a4c4b4e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_ced342cd98697453d4e1034d245349cb.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341006,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_cc7b578fbb1102f806f17e9106582e3e.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_8f1b2a85aa7927f06bb7489bbf9b7689.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_b515ae780ca936dcf465ea0b7cb0bbb3.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_964139525d72fcb4fe83fab7114f2ffe.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_afbdb00c6c321ec42a2b1e2325649700.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89465,
'Height': 768,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_db27fd35a812f1acdf2a470e383240cb.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_10.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_6484b1a621d9cfa815dc67756db189d6.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1096274-749d-51c6-8126-96e1bf7a592e/a1096274-749d-51c6-8126-96e1bf7a592e_image_11.png',
'Extension': 'png',
'FileSizeInBytes': 153321,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa597ba4ff7b8ed6d3c4bfca994ef2a/pa/GB12713_796949f37eda795448a290079681a659.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB12713%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [auto1.fr] INFO: Saving data for GB12713: {'created_time': 1764954665.782233, 'last_price_update_time': 1764954665.782246, 'auction_closing_time': 1765037650.0}
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GB12713') HTTP/1.1" 204 0
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_ec0b6ebdad6ddc2d279a18deee67e156.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_ec0b6ebdad6ddc2d279a18deee67e156.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_6276c4855e7196e745213400c4a06d52.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6276c4855e7196e745213400c4a06d52.png not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_08d8040692b071ea86a6be8346fd51bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_08d8040692b071ea86a6be8346fd51bd.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_4bb7ef012caff56745521dfab9281c2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_4bb7ef012caff56745521dfab9281c2f.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_3499781d66d0db589f039ea1e2a5b22b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3499781d66d0db589f039ea1e2a5b22b.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_abd411714f735847c17d6f1b88287ed3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_abd411714f735847c17d6f1b88287ed3.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_3d84bd530bac3cda62dc1c60cba254d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3d84bd530bac3cda62dc1c60cba254d6.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_63338b8673103252d91965dda4101979.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_63338b8673103252d91965dda4101979.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_aa4aecd7e32ad68731d12e608b00a834.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_aa4aecd7e32ad68731d12e608b00a834.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_79ec583cf4ba7222e4d7af7b48bee66b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_79ec583cf4ba7222e4d7af7b48bee66b.jpg not downloaded yet
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_3589f49e0ab5c30e86935f6defd155c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3589f49e0ab5c30e86935f6defd155c1.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_440f81ef60461390754852a512f24fd0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_440f81ef60461390754852a512f24fd0.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_af32e45ee960fde2846f41da950dfddc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_af32e45ee960fde2846f41da950dfddc.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_5991b584677989de0a58429b8b94cdfc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_5991b584677989de0a58429b8b94cdfc.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_236f0297727763252001ccecc8746607.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_236f0297727763252001ccecc8746607.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_d067bbb1a436f8d9a68909074a0fa32f.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_d067bbb1a436f8d9a68909074a0fa32f.png not downloaded yet
2025-12-05 17:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB93630> (referer: https://www.auto1.com/v1/car-details-view/HB93630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 with identifier: HB93630
2025-12-05 17:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 with scrape type 1
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_1315ff305c7f499eee810036fb06be82.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_fd818912e500516ef56b352503b9b3a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg not downloaded yet
2025-12-05 17:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_d067bbb1a436f8d9a68909074a0fa32f.png> (referer: https://www.auto1.com/)
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg not downloaded yet
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_472c7f5b526d56e54c463189c93c0675.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_e79f7728faee1a850afc1dfe8f348cef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_11a234fdbeda93ea369e99665bd41f59.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_25378f13419d0104060ce2fbc3994fe5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg not downloaded yet
2025-12-05 17:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b33810>
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_15.png HTTP/1.1" 201 0
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_d067bbb1a436f8d9a68909074a0fa32f.png') HTTP/1.1" 204 0
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_d067bbb1a436f8d9a68909074a0fa32f.png saved to cache
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_ccace15c7c73fe4faf1a8459738c1441.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg not downloaded yet
2025-12-05 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_4340e4e62afb700b201abb8704e0da34.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_63ee9e80f249694303e4c271c3229dde.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_3837217e11deb91a4990b63dbddc5a3b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_7c0f0e147edfc6b33e275cb647712844.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg not downloaded yet
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg not downloaded yet
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c586fa90>
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_fd818912e500516ef56b352503b9b3a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg saved to cache
2025-12-05 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df7fd0>
2025-12-05 17:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_25378f13419d0104060ce2fbc3994fe5.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg saved to cache
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:08 [scrapy.extensions.logstats] INFO: Crawled 805 pages (at 51 pages/min), scraped 192 items (at 9 items/min)
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c8fd1bd0>
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg saved to cache
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4a650>
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_7c0f0e147edfc6b33e275cb647712844.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg saved to cache
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71ca5154d0>
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_3837217e11deb91a4990b63dbddc5a3b.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg saved to cache
2025-12-05 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5828e10>
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg saved to cache
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d44910>
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg saved to cache
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5964750>
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_63ee9e80f249694303e4c271c3229dde.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg saved to cache
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58d1e90>
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_4340e4e62afb700b201abb8704e0da34.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg saved to cache
2025-12-05 17:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH90970> (referer: https://www.auto1.com/v1/car-details-view/RH90970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c92090>
2025-12-05 17:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_ccace15c7c73fe4faf1a8459738c1441.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg saved to cache
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86e1064a-340b-5930-a422-3ec24e804648 with identifier: RH90970
2025-12-05 17:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86e1064a-340b-5930-a422-3ec24e804648 with scrape type 1
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg not downloaded yet
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_73a8f752c522b62a50be91e3f4b23df3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg not downloaded yet
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_e63e184cb21dbb16e950e307f0c45abb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg not downloaded yet
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_eb8aa32793825d58eca216d853e3222d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg not downloaded yet
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_8692104914808dee2f9c96cc461d821e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg not downloaded yet
2025-12-05 17:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW42615> (referer: https://www.auto1.com/v1/car-details-view/PW42615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg not downloaded yet
2025-12-05 17:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg not downloaded yet
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg not downloaded yet
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f044d0>
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_11a234fdbeda93ea369e99665bd41f59.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg saved to cache
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59acb90>
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg saved to cache
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg not downloaded yet
2025-12-05 17:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg not downloaded yet
2025-12-05 17:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW12651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0de85ac-a084-5629-b130-7e001f720132 with identifier: PW42615
2025-12-05 17:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0de85ac-a084-5629-b130-7e001f720132 with scrape type 1
2025-12-05 17:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_860b818058683d4c7745dec2a8aa03fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_860b818058683d4c7745dec2a8aa03fd.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_fa89f0795bbc146f2e18d25a0a29d23a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_fa89f0795bbc146f2e18d25a0a29d23a.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_595d28438cd898af7708f52fb957d865.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg not downloaded yet
2025-12-05 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM97121> (referer: https://www.auto1.com/v1/car-details-view/AM97121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c599b590>
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg saved to cache
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_40288b781c5a5dcf8bd81fe30a20c5d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_40288b781c5a5dcf8bd81fe30a20c5d1.jpg not downloaded yet
2025-12-05 17:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_913414bfaa5c4051dd570e149d8a50b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg not downloaded yet
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d34fd0>
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_e79f7728faee1a850afc1dfe8f348cef.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg saved to cache
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_4b5aaac98a74842b9c870e50431d530e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_4b5aaac98a74842b9c870e50431d530e.jpg not downloaded yet
2025-12-05 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP21503> (referer: https://www.auto1.com/v1/car-details-view/JP21503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg not downloaded yet
2025-12-05 17:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_e32edaea64a5d40af28caced5ffccb78.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e32edaea64a5d40af28caced5ffccb78.jpg not downloaded yet
2025-12-05 17:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a11e4b4-4222-547e-81f1-13663ce38dbe with identifier: AM97121
2025-12-05 17:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a11e4b4-4222-547e-81f1-13663ce38dbe with scrape type 1
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_581ec544ab1d5cdbb87c429a99341910.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_581ec544ab1d5cdbb87c429a99341910.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_458f97bec336f9b874775da90cd1a8cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_458f97bec336f9b874775da90cd1a8cb.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_7d3d45b81570eb85aaa40e11a1b954ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7d3d45b81570eb85aaa40e11a1b954ed.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_c1d426c6383085f67e38189372e7da72.png%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_efe48d258bbdd1f898085295e578d66e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_efe48d258bbdd1f898085295e578d66e.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_437aeb5227ea0226375d381733e41ad6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_437aeb5227ea0226375d381733e41ad6.jpg not downloaded yet
2025-12-05 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_4b5aaac98a74842b9c870e50431d530e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_485316191b7ff0d026094a16c116ba4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_485316191b7ff0d026094a16c116ba4a.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_5c0950bb6e85e06984fd7ccdb4333fa6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5c0950bb6e85e06984fd7ccdb4333fa6.jpg not downloaded yet
2025-12-05 17:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9863d42-1734-5be2-8449-577de5f6f868 with identifier: JP21503
2025-12-05 17:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9863d42-1734-5be2-8449-577de5f6f868 with scrape type 1
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_422d119d4071287762bc2bac5d8d5bff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_422d119d4071287762bc2bac5d8d5bff.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_72a91d96a57abf604164c220c6f37892.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_72a91d96a57abf604164c220c6f37892.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_5e2c8409502898eca567434accdcc56a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5e2c8409502898eca567434accdcc56a.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_f44e51519666ba10896b4b63a2fabb39.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_f44e51519666ba10896b4b63a2fabb39.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_1985e5a2a519c4918656518a1eb8f945.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_1985e5a2a519c4918656518a1eb8f945.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_a4647f1546f847fc7edda06290ffbae4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_a4647f1546f847fc7edda06290ffbae4.jpg not downloaded yet
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_8f5dc8df2fc8dacd7cda8f48e79ae72a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8f5dc8df2fc8dacd7cda8f48e79ae72a.jpg not downloaded yet
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_437aeb5227ea0226375d381733e41ad6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_5170896a82135b8eecf6ac3d8e1112be.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_5170896a82135b8eecf6ac3d8e1112be.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_20e97fa2e4dff5520d0d251cf774fb22.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_20e97fa2e4dff5520d0d251cf774fb22.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_fb145b6acffaf1ac00bbab9082b93892.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_fb145b6acffaf1ac00bbab9082b93892.jpg not downloaded yet
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57765d0>
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_4b5aaac98a74842b9c870e50431d530e.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_4b5aaac98a74842b9c870e50431d530e.jpg saved to cache
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_6c606f337490e60d3209cc47376df8f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_6c606f337490e60d3209cc47376df8f1.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_978642c5c3cc62d1bf0b4523a2ac08a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_978642c5c3cc62d1bf0b4523a2ac08a4.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_a325c0f72d17963b5f1fc26d21ed851e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_a325c0f72d17963b5f1fc26d21ed851e.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_e3da430f4a580bfd7733b4b0c7990330.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e3da430f4a580bfd7733b4b0c7990330.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_1c446a1d72dffb3b72924e8853b44632.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_1c446a1d72dffb3b72924e8853b44632.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_8573b1b1be19cd995f52f1b262920b05.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8573b1b1be19cd995f52f1b262920b05.jpg not downloaded yet
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b1a310>
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_437aeb5227ea0226375d381733e41ad6.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_437aeb5227ea0226375d381733e41ad6.jpg saved to cache
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_288c6185cd67276832d20d55930cd01d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_288c6185cd67276832d20d55930cd01d.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_f3dd1d2eeb897a574b53de86ef6683cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f3dd1d2eeb897a574b53de86ef6683cd.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_07a2a39db2700e9705517b6bf24e6f63.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_07a2a39db2700e9705517b6bf24e6f63.jpg not downloaded yet
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8f5dc8df2fc8dacd7cda8f48e79ae72a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW69829> (referer: https://www.auto1.com/v1/car-details-view/TW69829/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM28528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM34990> (referer: https://www.auto1.com/v1/car-details-view/WM34990/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_3c142fc6c659c8a34b32233b47bbdecb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_3c142fc6c659c8a34b32233b47bbdecb.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_7e744b86125f62b7b57070940508f182.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7e744b86125f62b7b57070940508f182.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_44144c1828cf8d3e3db84fcb954a7c3d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_44144c1828cf8d3e3db84fcb954a7c3d.jpg not downloaded yet
2025-12-05 17:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_29bb260e1b1df7afc356186f009328da.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_29bb260e1b1df7afc356186f009328da.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_2be7f98306ac6768de96f5e4614ea446.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_2be7f98306ac6768de96f5e4614ea446.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_d4365d8e9ec08121594586557fbd1139.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_d4365d8e9ec08121594586557fbd1139.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_22017ce580a8125c7c0aa1009980d314.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_22017ce580a8125c7c0aa1009980d314.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_c4f4e167f9274b58a723080a35622344.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_c4f4e167f9274b58a723080a35622344.jpg not downloaded yet
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f3dd1d2eeb897a574b53de86ef6683cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_07a2a39db2700e9705517b6bf24e6f63.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8573b1b1be19cd995f52f1b262920b05.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_387b5db1b5a9fdae68c5a85f4ed98423.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_387b5db1b5a9fdae68c5a85f4ed98423.jpg not downloaded yet
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_bb9ade1b9e0d23ab176f5e63ed8dca25.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_bb9ade1b9e0d23ab176f5e63ed8dca25.jpg not downloaded yet
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d464d0>
2025-12-05 17:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_8f5dc8df2fc8dacd7cda8f48e79ae72a.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8f5dc8df2fc8dacd7cda8f48e79ae72a.jpg saved to cache
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17cd8af3-4d32-552d-a940-6b03c2ee4b45 with identifier: TW69829
2025-12-05 17:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17cd8af3-4d32-552d-a940-6b03c2ee4b45 with scrape type 2
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17cd8af3-4d32-552d-a940-6b03c2ee4b45 with scrape type 2
2025-12-05 17:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17cd8af3-4d32-552d-a940-6b03c2ee4b45, identifier: TW69829
2025-12-05 17:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c with identifier: WM34990
2025-12-05 17:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c with scrape type 1
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_b324e9f51902bca127c82f2cd60e5614.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg not downloaded yet
2025-12-05 17:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17cd8af3-4d32-552d-a940-6b03c2ee4b45 with identifier: TW69829
2025-12-05 17:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17cd8af3-4d32-552d-a940-6b03c2ee4b45 with identifier: TW69829
2025-12-05 17:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17cd8af3-4d32-552d-a940-6b03c2ee4b45 with identifier: TW69829 to the API
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW69829>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2025-12-06T16:14:53Z',
'fuel_type': 'petrol',
'id': '17cd8af3-4d32-552d-a940-6b03c2ee4b45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW69829',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Peugeot',
'model': '208',
'odometer': 104415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-03',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2016}
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW69829%27 HTTP/1.1" 200 None
2025-12-05 17:11:13 [auto1.fr] INFO: Saving data for TW69829: {'auction_closing_time': 1765037693.0, 'created_time': 1764396291.161363, 'last_price_update_time': 1764954673.930673}
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW69829') HTTP/1.1" 204 0
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_c64e71981b6558e1e1aab839b615e98d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c64e71981b6558e1e1aab839b615e98d.jpg not downloaded yet
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_5a7e1f7a9067bc90b1e777e9bdeefba4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5a7e1f7a9067bc90b1e777e9bdeefba4.jpg not downloaded yet
2025-12-05 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg not downloaded yet
2025-12-05 17:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_288c6185cd67276832d20d55930cd01d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575d8d0>
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_8692104914808dee2f9c96cc461d821e.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg saved to cache
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a0af10>
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_f3dd1d2eeb897a574b53de86ef6683cd.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f3dd1d2eeb897a574b53de86ef6683cd.jpg saved to cache
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a09310>
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_07a2a39db2700e9705517b6bf24e6f63.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_07a2a39db2700e9705517b6bf24e6f63.jpg saved to cache
2025-12-05 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c529d0>
2025-12-05 17:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_8573b1b1be19cd995f52f1b262920b05.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8573b1b1be19cd995f52f1b262920b05.jpg saved to cache
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_407763e6eb155f3ba64497469e262df5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_407763e6eb155f3ba64497469e262df5.jpg not downloaded yet
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_b7674d4ddb3a3e28c97fe3a0a6363ef4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b7674d4ddb3a3e28c97fe3a0a6363ef4.jpg not downloaded yet
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg not downloaded yet
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_22017ce580a8125c7c0aa1009980d314.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_d4365d8e9ec08121594586557fbd1139.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_c4f4e167f9274b58a723080a35622344.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_c3a914012e263ba058dd2e6622bd86b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c3a914012e263ba058dd2e6622bd86b3.jpg not downloaded yet
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_5e69d5880e1ba83ac962e1289bfe8333.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5e69d5880e1ba83ac962e1289bfe8333.jpg not downloaded yet
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e19ff13659341b810e2e8d171d3dcd14.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg not downloaded yet
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK89791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY38052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD25235> (referer: https://www.auto1.com/v1/car-details-view/KD25235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5924cd0>
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_288c6185cd67276832d20d55930cd01d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_288c6185cd67276832d20d55930cd01d.jpg saved to cache
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_2be7f98306ac6768de96f5e4614ea446.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_f01e860e3700f96e5723696acdbdd5f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f01e860e3700f96e5723696acdbdd5f9.jpg not downloaded yet
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_00ce86bd2cd2b0f6781efd941ae1954d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_00ce86bd2cd2b0f6781efd941ae1954d.jpg not downloaded yet
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_6bdf75543d69c50074979803ff116edb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg not downloaded yet
2025-12-05 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea34d0>
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg saved to cache
2025-12-05 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5967090>
2025-12-05 17:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_22017ce580a8125c7c0aa1009980d314.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_22017ce580a8125c7c0aa1009980d314.jpg saved to cache
2025-12-05 17:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58bd250>
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_d4365d8e9ec08121594586557fbd1139.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_d4365d8e9ec08121594586557fbd1139.jpg saved to cache
2025-12-05 17:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b79210>
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_c4f4e167f9274b58a723080a35622344.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_c4f4e167f9274b58a723080a35622344.jpg saved to cache
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b6c710>
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg saved to cache
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e87878f6-7c41-5df2-8b33-39d55e1cdcbb with identifier: KD25235
2025-12-05 17:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87878f6-7c41-5df2-8b33-39d55e1cdcbb with scrape type 2
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e87878f6-7c41-5df2-8b33-39d55e1cdcbb with scrape type 2
2025-12-05 17:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e87878f6-7c41-5df2-8b33-39d55e1cdcbb, identifier: KD25235
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_fe573b259f705b5584f604677ed847a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_fe573b259f705b5584f604677ed847a6.jpg not downloaded yet
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_aa985313405789894e4720980cf74d4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_aa985313405789894e4720980cf74d4d.jpg not downloaded yet
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg not downloaded yet
2025-12-05 17:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e87878f6-7c41-5df2-8b33-39d55e1cdcbb with identifier: KD25235
2025-12-05 17:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e87878f6-7c41-5df2-8b33-39d55e1cdcbb with identifier: KD25235
2025-12-05 17:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 146486, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd25235', 'expiration_date': '2025-12-06t16:39:17z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': 'e87878f6-7c41-5df2-8b33-39d55e1cdcbb', 'current_year_diff': 7, 'age_in_months': 88, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 146486}
Failed validating None in schema:
False
On instance:
{'age_in_months': 88,
'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:39:17z',
'fuel_type': 'petrol',
'id': 'e87878f6-7c41-5df2-8b33-39d55e1cdcbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd25235',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 146486,
'odometer_in_km': 146486,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2018}
2025-12-05 17:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e87878f6-7c41-5df2-8b33-39d55e1cdcbb spider: auto1.fr
2025-12-05 17:11:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e87878f6-7c41-5df2-8b33-39d55e1cdcbb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 146486, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd25235', 'expiration_date': '2025-12-06t16:39:17z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': 'e87878f6-7c41-5df2-8b33-39d55e1cdcbb', 'current_year_diff': 7, 'age_in_months': 88, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 146486}
Failed validating None in schema:
False
On instance:
{'age_in_months': 88,
'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 130,
'expiration_date': '2025-12-06t16:39:17z',
'fuel_type': 'petrol',
'id': 'e87878f6-7c41-5df2-8b33-39d55e1cdcbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd25235',
'listing': 'auction',
'location': 'fr, marseille',
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 146486,
'odometer_in_km': 146486,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2025-12-06T16:39:17Z',
'fuel_type': 'petrol',
'id': 'e87878f6-7c41-5df2-8b33-39d55e1cdcbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD25235',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Peugeot',
'model': '3008',
'odometer': 146486,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD25235%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [auto1.fr] INFO: Saving data for KD25235: {'auction_closing_time': 1765039157.0, 'created_time': 1763658380.603814, 'last_price_update_time': 1764954677.891786}
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD25235') HTTP/1.1" 204 0
2025-12-05 17:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5a7e1f7a9067bc90b1e777e9bdeefba4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_407763e6eb155f3ba64497469e262df5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b7674d4ddb3a3e28c97fe3a0a6363ef4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_0f742f5704edadc5fa1fd5a4d3a71000.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_0f742f5704edadc5fa1fd5a4d3a71000.jpg not downloaded yet
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_e368d477e782f9728aba6fafdef77267.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_e368d477e782f9728aba6fafdef77267.jpg not downloaded yet
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_fc6e47153245836eaff2c3a23286d43b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg not downloaded yet
2025-12-05 17:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD41847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ35727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ec210>
2025-12-05 17:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg saved to cache
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5998950>
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_2be7f98306ac6768de96f5e4614ea446.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_2be7f98306ac6768de96f5e4614ea446.jpg saved to cache
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e2ca90>
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg saved to cache
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_b5814958945abc7fbcdf371c7a5d5608.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b5814958945abc7fbcdf371c7a5d5608.jpg not downloaded yet
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_4387956b3b0009a6a5ca235ecd413598.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg not downloaded yet
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59732d0>
2025-12-05 17:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_5a7e1f7a9067bc90b1e777e9bdeefba4.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5a7e1f7a9067bc90b1e777e9bdeefba4.jpg saved to cache
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7b590>
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_407763e6eb155f3ba64497469e262df5.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_407763e6eb155f3ba64497469e262df5.jpg saved to cache
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c7ac90>
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_b7674d4ddb3a3e28c97fe3a0a6363ef4.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b7674d4ddb3a3e28c97fe3a0a6363ef4.jpg saved to cache
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_aa985313405789894e4720980cf74d4d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_fe573b259f705b5584f604677ed847a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_b4dac898015851d125ee7c6ade9f8fd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b4dac898015851d125ee7c6ade9f8fd7.jpg not downloaded yet
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg not downloaded yet
2025-12-05 17:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f01e860e3700f96e5723696acdbdd5f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_00ce86bd2cd2b0f6781efd941ae1954d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_67306815fe2f502dd21c3922a005edbf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_67306815fe2f502dd21c3922a005edbf.jpg not downloaded yet
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_479ba4d502bbcdc877d229c788243a5d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg not downloaded yet
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg not downloaded yet
2025-12-05 17:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e3f50>
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_595d28438cd898af7708f52fb957d865.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg saved to cache
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5e69d5880e1ba83ac962e1289bfe8333.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c3a914012e263ba058dd2e6622bd86b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_f77050a3602050cc79af04e1e2138074.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg not downloaded yet
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59e0a10>
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_aa985313405789894e4720980cf74d4d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_aa985313405789894e4720980cf74d4d.jpg saved to cache
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e33b10>
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_fe573b259f705b5584f604677ed847a6.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_fe573b259f705b5584f604677ed847a6.jpg saved to cache
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e34adddd9779b2f901057cde4f951461.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg not downloaded yet
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7f310>
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_f01e860e3700f96e5723696acdbdd5f9.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f01e860e3700f96e5723696acdbdd5f9.jpg saved to cache
2025-12-05 17:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb0cd0>
2025-12-05 17:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_00ce86bd2cd2b0f6781efd941ae1954d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_00ce86bd2cd2b0f6781efd941ae1954d.jpg saved to cache
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef4c90>
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_fc6e47153245836eaff2c3a23286d43b.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg saved to cache
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cfbd0>
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e19ff13659341b810e2e8d171d3dcd14.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg saved to cache
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c79090>
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_5e69d5880e1ba83ac962e1289bfe8333.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5e69d5880e1ba83ac962e1289bfe8333.jpg saved to cache
2025-12-05 17:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7d590>
2025-12-05 17:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_c3a914012e263ba058dd2e6622bd86b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c3a914012e263ba058dd2e6622bd86b3.jpg saved to cache
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b5814958945abc7fbcdf371c7a5d5608.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_23490f8830563177b8c6b2ffef73a90f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg not downloaded yet
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY38052> (referer: https://www.auto1.com/v1/car-details-view/TY38052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg not downloaded yet
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK89791> (referer: https://www.auto1.com/v1/car-details-view/AK89791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_67306815fe2f502dd21c3922a005edbf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_8da35dc47f44e33f33916a7f52947751.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg not downloaded yet
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d0b9d0>
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_b5814958945abc7fbcdf371c7a5d5608.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b5814958945abc7fbcdf371c7a5d5608.jpg saved to cache
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444adb2a-1197-5fa5-8c99-c410c128e175 with identifier: TY38052
2025-12-05 17:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444adb2a-1197-5fa5-8c99-c410c128e175 with scrape type 2
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 444adb2a-1197-5fa5-8c99-c410c128e175 with scrape type 2
2025-12-05 17:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 444adb2a-1197-5fa5-8c99-c410c128e175, identifier: TY38052
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c790f090>
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_4387956b3b0009a6a5ca235ecd413598.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg saved to cache
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d6d201-be34-5024-9f53-df3ef1437b99 with identifier: AK89791
2025-12-05 17:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d6d201-be34-5024-9f53-df3ef1437b99 with scrape type 2
2025-12-05 17:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d6d201-be34-5024-9f53-df3ef1437b99 with scrape type 2
2025-12-05 17:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46d6d201-be34-5024-9f53-df3ef1437b99, identifier: AK89791
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b22d0>
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_67306815fe2f502dd21c3922a005edbf.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_67306815fe2f502dd21c3922a005edbf.jpg saved to cache
2025-12-05 17:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 444adb2a-1197-5fa5-8c99-c410c128e175 with identifier: TY38052
2025-12-05 17:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 444adb2a-1197-5fa5-8c99-c410c128e175 with identifier: TY38052
2025-12-05 17:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 444adb2a-1197-5fa5-8c99-c410c128e175 spider: auto1.fr
2025-12-05 17:11:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 444adb2a-1197-5fa5-8c99-c410c128e175 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2025-12-06T16:37:38Z',
'fuel_type': 'diesel',
'id': '444adb2a-1197-5fa5-8c99-c410c128e175',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY38052',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 121529,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-05',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Club L1',
'transmission': 'manual',
'trim': 'Club L1',
'year': 2018}
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY38052%27 HTTP/1.1" 200 None
2025-12-05 17:11:23 [auto1.fr] INFO: Saving data for TY38052: {'auction_closing_time': 1765039058.0, 'created_time': 1764350147.5772, 'last_price_update_time': 1764954683.4745}
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY38052') HTTP/1.1" 204 0
2025-12-05 17:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46d6d201-be34-5024-9f53-df3ef1437b99 with identifier: AK89791
2025-12-05 17:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46d6d201-be34-5024-9f53-df3ef1437b99 with identifier: AK89791
2025-12-05 17:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2025-12-05 17:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 46d6d201-be34-5024-9f53-df3ef1437b99 spider: auto1.fr
2025-12-05 17:11:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 46d6d201-be34-5024-9f53-df3ef1437b99 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
'c_o_2_emission_value': 191,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 145,
'expiration_date': '2025-12-06T16:27:55Z',
'fuel_type': 'diesel',
'id': '46d6d201-be34-5024-9f53-df3ef1437b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK89791',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Renault',
'model': 'Trafic',
'odometer': 74052,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-23',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi Energy L1H1 1000 Confort',
'transmission': 'automatic',
'trim': 'L1H1 1000 Confort',
'year': 2020}
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK89791%27 HTTP/1.1" 200 None
2025-12-05 17:11:23 [auto1.fr] INFO: Saving data for AK89791: {'auction_closing_time': 1765038475.0, 'created_time': 1764349808.779299, 'last_price_update_time': 1764954683.699011}
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK89791') HTTP/1.1" 204 0
2025-12-05 17:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD41847> (referer: https://www.auto1.com/v1/car-details-view/BD41847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dac2d0>
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e34adddd9779b2f901057cde4f951461.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg saved to cache
2025-12-05 17:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578f510>
2025-12-05 17:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg saved to cache
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b4dac898015851d125ee7c6ade9f8fd7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ24715> (referer: https://www.auto1.com/v1/car-details-view/TJ24715/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c93450>
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_23490f8830563177b8c6b2ffef73a90f.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg saved to cache
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b31650>
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_f77050a3602050cc79af04e1e2138074.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg saved to cache
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff5eed9-8275-5c92-a02b-72f2b61d8044 with identifier: BD41847
2025-12-05 17:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff5eed9-8275-5c92-a02b-72f2b61d8044 with scrape type 2
2025-12-05 17:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff5eed9-8275-5c92-a02b-72f2b61d8044 with scrape type 2
2025-12-05 17:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dff5eed9-8275-5c92-a02b-72f2b61d8044, identifier: BD41847
2025-12-05 17:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dff5eed9-8275-5c92-a02b-72f2b61d8044 with identifier: BD41847
2025-12-05 17:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dff5eed9-8275-5c92-a02b-72f2b61d8044 with identifier: BD41847
2025-12-05 17:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dff5eed9-8275-5c92-a02b-72f2b61d8044 with identifier: BD41847 to the API
2025-12-05 17:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD41847>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:33:04Z',
'fuel_type': 'diesel',
'id': 'dff5eed9-8275-5c92-a02b-72f2b61d8044',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD41847',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Audi',
'model': 'Q2',
'odometer': 144475,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.6 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2025-12-05 17:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD41847%27 HTTP/1.1" 200 None
2025-12-05 17:11:26 [auto1.fr] INFO: Saving data for BD41847: {'auction_closing_time': 1765038784.0, 'created_time': 1762277701.056172, 'last_price_update_time': 1764954686.828451}
2025-12-05 17:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD41847') HTTP/1.1" 204 0
2025-12-05 17:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_e368d477e782f9728aba6fafdef77267.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_0f742f5704edadc5fa1fd5a4d3a71000.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c64e71981b6558e1e1aab839b615e98d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cedd50>
2025-12-05 17:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_b4dac898015851d125ee7c6ade9f8fd7.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b4dac898015851d125ee7c6ade9f8fd7.jpg saved to cache
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 with identifier: TJ24715
2025-12-05 17:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 with scrape type 1
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_1635e8ba47b5d192ab5223b15835890c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg not downloaded yet
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b53690>
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg saved to cache
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da35d0>
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_b324e9f51902bca127c82f2cd60e5614.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg saved to cache
2025-12-05 17:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b53d90>
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg saved to cache
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_bb9ade1b9e0d23ab176f5e63ed8dca25.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg not downloaded yet
2025-12-05 17:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ35727> (referer: https://www.auto1.com/v1/car-details-view/DJ35727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e22d50>
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_8da35dc47f44e33f33916a7f52947751.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg saved to cache
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0fc50>
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_e368d477e782f9728aba6fafdef77267.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_e368d477e782f9728aba6fafdef77267.jpg saved to cache
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b53a10>
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_0f742f5704edadc5fa1fd5a4d3a71000.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_0f742f5704edadc5fa1fd5a4d3a71000.jpg saved to cache
2025-12-05 17:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fe0d0>
2025-12-05 17:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_c64e71981b6558e1e1aab839b615e98d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c64e71981b6558e1e1aab839b615e98d.jpg saved to cache
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg not downloaded yet
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg not downloaded yet
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg not downloaded yet
2025-12-05 17:11:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df7690>
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg saved to cache
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb9250>
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_6bdf75543d69c50074979803ff116edb.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg saved to cache
2025-12-05 17:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e236d0>
2025-12-05 17:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_bb9ade1b9e0d23ab176f5e63ed8dca25.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_bb9ade1b9e0d23ab176f5e63ed8dca25.jpg saved to cache
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374cfdbc-7bf8-5d3b-97bd-719bdca4426d with identifier: DJ35727
2025-12-05 17:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374cfdbc-7bf8-5d3b-97bd-719bdca4426d with scrape type 2
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 374cfdbc-7bf8-5d3b-97bd-719bdca4426d with scrape type 2
2025-12-05 17:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 374cfdbc-7bf8-5d3b-97bd-719bdca4426d, identifier: DJ35727
2025-12-05 17:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 374cfdbc-7bf8-5d3b-97bd-719bdca4426d with identifier: DJ35727
2025-12-05 17:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 374cfdbc-7bf8-5d3b-97bd-719bdca4426d with identifier: DJ35727
2025-12-05 17:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 374cfdbc-7bf8-5d3b-97bd-719bdca4426d with identifier: DJ35727 to the API
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ35727>
{'auction_title': '',
'c_o_2_emission_value': 82,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:38:41Z',
'fuel_type': 'hybrid',
'id': '374cfdbc-7bf8-5d3b-97bd-719bdca4426d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ35727',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Toyota',
'model': 'Auris',
'odometer': 143216,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.8 Hybrid Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2016}
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ35727%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [auto1.fr] INFO: Saving data for DJ35727: {'auction_closing_time': 1765039121.0, 'created_time': 1764350246.667953, 'last_price_update_time': 1764954690.613331}
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ35727') HTTP/1.1" 204 0
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg not downloaded yet
2025-12-05 17:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM28528> (referer: https://www.auto1.com/v1/car-details-view/LM28528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_abfb79fd72936f2bce89e95038281a37.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg not downloaded yet
2025-12-05 17:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg not downloaded yet
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_f31169036139a9cf95c803ae471568f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg not downloaded yet
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_11d08dfe524a556837e8eb9324d82c62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg not downloaded yet
2025-12-05 17:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg not downloaded yet
2025-12-05 17:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg not downloaded yet
2025-12-05 17:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67297ba-a7e4-56b0-95c4-59ebd90fcec6 with identifier: LM28528
2025-12-05 17:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67297ba-a7e4-56b0-95c4-59ebd90fcec6 with scrape type 2
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67297ba-a7e4-56b0-95c4-59ebd90fcec6 with scrape type 2
2025-12-05 17:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d67297ba-a7e4-56b0-95c4-59ebd90fcec6, identifier: LM28528
2025-12-05 17:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_387b5db1b5a9fdae68c5a85f4ed98423.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg not downloaded yet
2025-12-05 17:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d67297ba-a7e4-56b0-95c4-59ebd90fcec6 with identifier: LM28528
2025-12-05 17:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d67297ba-a7e4-56b0-95c4-59ebd90fcec6 with identifier: LM28528
2025-12-05 17:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d67297ba-a7e4-56b0-95c4-59ebd90fcec6 with identifier: LM28528 to the API
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LM28528>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:30:39Z',
'fuel_type': 'diesel',
'id': 'd67297ba-a7e4-56b0-95c4-59ebd90fcec6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM28528',
'listing': 'auction',
'location': 'FR, Vitrolles',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 75292,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2021}
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM28528%27 HTTP/1.1" 200 None
2025-12-05 17:11:31 [auto1.fr] INFO: Saving data for LM28528: {'auction_closing_time': 1765038639.0, 'created_time': 1763539273.485509, 'last_price_update_time': 1764954691.555078}
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LM28528') HTTP/1.1" 204 0
2025-12-05 17:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_29bb260e1b1df7afc356186f009328da.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg not downloaded yet
2025-12-05 17:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_44144c1828cf8d3e3db84fcb954a7c3d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e50c50>
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_479ba4d502bbcdc877d229c788243a5d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg saved to cache
2025-12-05 17:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cf610>
2025-12-05 17:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F83%252Faa83f7e3c2a34e16203b46b1d264aba4%252Fpa%252FWM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg saved to cache
2025-12-05 17:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c
2025-12-05 17:11:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c, skipping ID generation
2025-12-05 17:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c with scrape type 1
2025-12-05 17:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c from tracking dictionaries
2025-12-05 17:11:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70d38036-3cbe-5914-9cd3-cae3ae7bf25c sending to next pipeline
2025-12-05 17:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c, identifier: WM34990
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cfd90>
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_1635e8ba47b5d192ab5223b15835890c.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg saved to cache
2025-12-05 17:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59e3e10>
2025-12-05 17:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_387b5db1b5a9fdae68c5a85f4ed98423.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_387b5db1b5a9fdae68c5a85f4ed98423.jpg saved to cache
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_3c142fc6c659c8a34b32233b47bbdecb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg not downloaded yet
2025-12-05 17:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c with identifier: WM34990
2025-12-05 17:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c with identifier: WM34990
2025-12-05 17:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.6 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 103619, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wm34990', 'expiration_date': '2025-12-06t16:48:14z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 225, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, montivillier', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': '70d38036-3cbe-5914-9cd3-cae3ae7bf25c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2551638}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2483275}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55106}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2478578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2476105}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55972}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2504963}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2881688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58099}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54172}], 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 103619}
Failed validating None in schema:
False
On instance:
{'age_in_months': 90,
'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'engine_horse_power': 225,
'expiration_date': '2025-12-06t16:48:14z',
'fuel_type': 'petrol',
'id': '70d38036-3cbe-5914-9cd3-cae3ae7bf25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wm34990',
'listing': 'auction',
'location': 'fr, montivillier',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 103619,
'odometer_in_km': 103619,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551638,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2483275,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2476105,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2504963,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881688,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.6 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2018}
2025-12-05 17:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c spider: auto1.fr
2025-12-05 17:11:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 70d38036-3cbe-5914-9cd3-cae3ae7bf25c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.6 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 103619, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wm34990', 'expiration_date': '2025-12-06t16:48:14z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 225, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, montivillier', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': '70d38036-3cbe-5914-9cd3-cae3ae7bf25c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2551638}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2483275}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55106}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2478578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2476105}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55972}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2504963}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2881688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58099}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 52139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54172}], 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 103619}
Failed validating None in schema:
False
On instance:
{'age_in_months': 90,
'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.6l',
'engine_horse_power': 225,
'expiration_date': '2025-12-06t16:48:14z',
'fuel_type': 'petrol',
'id': '70d38036-3cbe-5914-9cd3-cae3ae7bf25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wm34990',
'listing': 'auction',
'location': 'fr, montivillier',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 103619,
'odometer_in_km': 103619,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551638,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2483275,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2476105,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2504963,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881688,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.6 puretech gt',
'transmission': 'automatic',
'trim': 'gt',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 225,
'expiration_date': '2025-12-06T16:48:14Z',
'fuel_type': 'petrol',
'id': '70d38036-3cbe-5914-9cd3-cae3ae7bf25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM34990',
'listing': 'auction',
'location': 'FR, Montivillier',
'make': 'Peugeot',
'model': '308',
'odometer': 103619,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551638,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_b324e9f51902bca127c82f2cd60e5614.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_d01a33f550ce9706ee8c29e6ea60edd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2483275,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e1cfe47eb7eb0ff6166dd5c4bc27a10c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e19ff13659341b810e2e8d171d3dcd14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2478578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_6bdf75543d69c50074979803ff116edb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2476105,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e4c77411cbdc331ac1d139eaf6eedddd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_fc6e47153245836eaff2c3a23286d43b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_4387956b3b0009a6a5ca235ecd413598.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_37f67b7f4ff2047a42e8c0be26fee610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2504963,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_479ba4d502bbcdc877d229c788243a5d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881688,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8fc974f3c457fd3db0ed561056e2c2d5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_f77050a3602050cc79af04e1e2138074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_e34adddd9779b2f901057cde4f951461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_23490f8830563177b8c6b2ffef73a90f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_04526ca5df6b455e812a4b4f9ee6e475.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d38036-3cbe-5914-9cd3-cae3ae7bf25c/70d38036-3cbe-5914-9cd3-cae3ae7bf25c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/83/aa83f7e3c2a34e16203b46b1d264aba4/pa/WM34990_8da35dc47f44e33f33916a7f52947751.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM34990%27 HTTP/1.1" 200 None
2025-12-05 17:11:33 [auto1.fr] INFO: Saving data for WM34990: {'created_time': 1764954693.372741, 'last_price_update_time': 1764954693.37275, 'auction_closing_time': 1765039694.0}
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM34990') HTTP/1.1" 204 0
2025-12-05 17:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_1c446a1d72dffb3b72924e8853b44632.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7e744b86125f62b7b57070940508f182.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_85d66c0056633eedae72b02c4a159450.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg not downloaded yet
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b1290>
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_29bb260e1b1df7afc356186f009328da.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_29bb260e1b1df7afc356186f009328da.jpg saved to cache
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d53510>
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg saved to cache
2025-12-05 17:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f1c50>
2025-12-05 17:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_44144c1828cf8d3e3db84fcb954a7c3d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_44144c1828cf8d3e3db84fcb954a7c3d.jpg saved to cache
2025-12-05 17:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e3da430f4a580bfd7733b4b0c7990330.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5775350>
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_3c142fc6c659c8a34b32233b47bbdecb.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_3c142fc6c659c8a34b32233b47bbdecb.jpg saved to cache
2025-12-05 17:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.694(s), this was the 1st time calling it.
2025-12-05 17:11:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.44134030055185 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bd5a50>
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_1c446a1d72dffb3b72924e8853b44632.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_1c446a1d72dffb3b72924e8853b44632.jpg saved to cache
2025-12-05 17:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d8fd10>
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_7e744b86125f62b7b57070940508f182.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7e744b86125f62b7b57070940508f182.jpg saved to cache
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5813f50>
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_e3da430f4a580bfd7733b4b0c7990330.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e3da430f4a580bfd7733b4b0c7990330.jpg saved to cache
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bd7310>
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg saved to cache
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b78cd0>
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg saved to cache
2025-12-05 17:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4da36d0>
2025-12-05 17:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg saved to cache
2025-12-05 17:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f1d50>
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg saved to cache
2025-12-05 17:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_a325c0f72d17963b5f1fc26d21ed851e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_6c606f337490e60d3209cc47376df8f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_fb145b6acffaf1ac00bbab9082b93892.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_20e97fa2e4dff5520d0d251cf774fb22.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_5170896a82135b8eecf6ac3d8e1112be.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_978642c5c3cc62d1bf0b4523a2ac08a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_a4647f1546f847fc7edda06290ffbae4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c9c50>
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_11d08dfe524a556837e8eb9324d82c62.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg saved to cache
2025-12-05 17:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bcbdd0>
2025-12-05 17:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_f31169036139a9cf95c803ae471568f5.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg saved to cache
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ba6ad0>
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg saved to cache
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b967d0>
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg saved to cache
2025-12-05 17:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c99110>
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg saved to cache
2025-12-05 17:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb4e90>
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg saved to cache
2025-12-05 17:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ba4210>
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_abfb79fd72936f2bce89e95038281a37.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg saved to cache
2025-12-05 17:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c9a090>
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg saved to cache
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb4090>
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_a325c0f72d17963b5f1fc26d21ed851e.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_a325c0f72d17963b5f1fc26d21ed851e.jpg saved to cache
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ba63d0>
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg saved to cache
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c9b650>
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_6c606f337490e60d3209cc47376df8f1.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_6c606f337490e60d3209cc47376df8f1.jpg saved to cache
2025-12-05 17:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b3c590>
2025-12-05 17:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_fb145b6acffaf1ac00bbab9082b93892.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_fb145b6acffaf1ac00bbab9082b93892.jpg saved to cache
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b8e390>
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_20e97fa2e4dff5520d0d251cf774fb22.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_20e97fa2e4dff5520d0d251cf774fb22.jpg saved to cache
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b3efd0>
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_5170896a82135b8eecf6ac3d8e1112be.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_5170896a82135b8eecf6ac3d8e1112be.jpg saved to cache
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b44410>
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_978642c5c3cc62d1bf0b4523a2ac08a4.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_978642c5c3cc62d1bf0b4523a2ac08a4.jpg saved to cache
2025-12-05 17:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bc2110>
2025-12-05 17:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_a4647f1546f847fc7edda06290ffbae4.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_a4647f1546f847fc7edda06290ffbae4.jpg saved to cache
2025-12-05 17:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b49290>
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc0%252Fa5c027a969ebb5bc0bf2b45fda5f9e4d%252Fpa%252FTJ24715_85d66c0056633eedae72b02c4a159450.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg saved to cache
2025-12-05 17:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2
2025-12-05 17:11:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2, skipping ID generation
2025-12-05 17:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 with scrape type 1
2025-12-05 17:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 from tracking dictionaries
2025-12-05 17:11:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 sending to next pipeline
2025-12-05 17:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2, identifier: TJ24715
2025-12-05 17:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 with identifier: TJ24715
2025-12-05 17:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 with identifier: TJ24715
2025-12-05 17:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 87628, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tj24715', 'expiration_date': '2025-12-06t16:05:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, montivillier', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2151258}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2055928}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2018743}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 1950744}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2102028}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70317}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83768}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49025}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56428}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55402}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 40694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2466030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83211}], 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 87628}
Failed validating None in schema:
False
On instance:
{'age_in_months': 70,
'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:05:08z',
'fuel_type': 'petrol',
'id': 'fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tj24715',
'listing': 'auction',
'location': 'fr, montivillier',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 87628,
'odometer_in_km': 87628,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2151258,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2055928,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2018743,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1950744,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102028,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466030,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2020}
2025-12-05 17:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 spider: auto1.fr
2025-12-05 17:11:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 87628, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tj24715', 'expiration_date': '2025-12-06t16:05:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, montivillier', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2151258}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2055928}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2018743}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 1950744}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2102028}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70317}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83768}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49025}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56428}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55402}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 40694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2466030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83211}], 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 87628}
Failed validating None in schema:
False
On instance:
{'age_in_months': 70,
'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 101,
'expiration_date': '2025-12-06t16:05:08z',
'fuel_type': 'petrol',
'id': 'fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tj24715',
'listing': 'auction',
'location': 'fr, montivillier',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 87628,
'odometer_in_km': 87628,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2151258,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2055928,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2018743,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1950744,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102028,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466030,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 puretech allure',
'transmission': 'manual',
'trim': 'allure',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:05:08Z',
'fuel_type': 'petrol',
'id': 'fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ24715',
'listing': 'auction',
'location': 'FR, Montivillier',
'make': 'Peugeot',
'model': '208',
'odometer': 87628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_1635e8ba47b5d192ab5223b15835890c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2151258,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4f4f05a5baf2166bea7f834030d5e1df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2055928,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_8f66dd6a85c228d9ef6c3312ba96d7df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2018743,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c25d588d1e6388844d7ad328ff58d3f3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1950744,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_c38242da0cef6a4fa1ea02983d389f86.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b7561ecc0ddb50ac95de3f9266f1e053.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102028,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_abfb79fd72936f2bce89e95038281a37.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_13d14c47dff2dbda57b9d703fb8962a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f31169036139a9cf95c803ae471568f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_11d08dfe524a556837e8eb9324d82c62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_f1372122609ffa056a779f0ceecd2d9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_4e47a8778639fdfcf37751c9bfce4d81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_107fd75fb0ac8e4cd0cd311753f14a93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2466030,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_15b6b2ea4b34b9cc3c03a657bfba50b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_b98a53b8fef47f6b7eb6900f54e02323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2/fc41a05e-8bf8-582c-9fe2-cac1c14ac2c2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/c0/a5c027a969ebb5bc0bf2b45fda5f9e4d/pa/TJ24715_85d66c0056633eedae72b02c4a159450.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ24715%27 HTTP/1.1" 200 None
2025-12-05 17:11:41 [auto1.fr] INFO: Saving data for TJ24715: {'created_time': 1764954701.958296, 'last_price_update_time': 1764954701.958306, 'auction_closing_time': 1765037108.0}
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ24715') HTTP/1.1" 204 0
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_1985e5a2a519c4918656518a1eb8f945.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_efe48d258bbdd1f898085295e578d66e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_485316191b7ff0d026094a16c116ba4a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_f44e51519666ba10896b4b63a2fabb39.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_422d119d4071287762bc2bac5d8d5bff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_72a91d96a57abf604164c220c6f37892.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_581ec544ab1d5cdbb87c429a99341910.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_458f97bec336f9b874775da90cd1a8cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e32edaea64a5d40af28caced5ffccb78.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_40288b781c5a5dcf8bd81fe30a20c5d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_fa89f0795bbc146f2e18d25a0a29d23a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e30950>
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_1985e5a2a519c4918656518a1eb8f945.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_1985e5a2a519c4918656518a1eb8f945.jpg saved to cache
2025-12-05 17:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5e2c8409502898eca567434accdcc56a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5c0950bb6e85e06984fd7ccdb4333fa6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_860b818058683d4c7745dec2a8aa03fd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7d3d45b81570eb85aaa40e11a1b954ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ab9d0>
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_efe48d258bbdd1f898085295e578d66e.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_efe48d258bbdd1f898085295e578d66e.jpg saved to cache
2025-12-05 17:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dac2d0>
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_485316191b7ff0d026094a16c116ba4a.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_485316191b7ff0d026094a16c116ba4a.jpg saved to cache
2025-12-05 17:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c978d0>
2025-12-05 17:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_f44e51519666ba10896b4b63a2fabb39.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_f44e51519666ba10896b4b63a2fabb39.jpg saved to cache
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dadc10>
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ffe%252F1efe1f19ea7f1b71bc6c1816fffc6019%252Fpa%252FJP21503_422d119d4071287762bc2bac5d8d5bff.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_422d119d4071287762bc2bac5d8d5bff.jpg saved to cache
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9863d42-1734-5be2-8449-577de5f6f868
2025-12-05 17:11:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9863d42-1734-5be2-8449-577de5f6f868, skipping ID generation
2025-12-05 17:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9863d42-1734-5be2-8449-577de5f6f868 with scrape type 1
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a9863d42-1734-5be2-8449-577de5f6f868 from tracking dictionaries
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9863d42-1734-5be2-8449-577de5f6f868 sending to next pipeline
2025-12-05 17:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9863d42-1734-5be2-8449-577de5f6f868, identifier: JP21503
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57df410>
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_72a91d96a57abf604164c220c6f37892.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_72a91d96a57abf604164c220c6f37892.jpg saved to cache
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e21010>
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_581ec544ab1d5cdbb87c429a99341910.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_581ec544ab1d5cdbb87c429a99341910.jpg saved to cache
2025-12-05 17:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3c390>
2025-12-05 17:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_458f97bec336f9b874775da90cd1a8cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_458f97bec336f9b874775da90cd1a8cb.jpg saved to cache
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a94790>
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_e32edaea64a5d40af28caced5ffccb78.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e32edaea64a5d40af28caced5ffccb78.jpg saved to cache
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c97510>
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg saved to cache
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57a8210>
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_40288b781c5a5dcf8bd81fe30a20c5d1.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_40288b781c5a5dcf8bd81fe30a20c5d1.jpg saved to cache
2025-12-05 17:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9c590>
2025-12-05 17:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_fa89f0795bbc146f2e18d25a0a29d23a.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_fa89f0795bbc146f2e18d25a0a29d23a.jpg saved to cache
2025-12-05 17:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9863d42-1734-5be2-8449-577de5f6f868 with identifier: JP21503
2025-12-05 17:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9863d42-1734-5be2-8449-577de5f6f868 with identifier: JP21503
2025-12-05 17:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9863d42-1734-5be2-8449-577de5f6f868 with identifier: JP21503 to the API
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_422d119d4071287762bc2bac5d8d5bff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2025-12-06T16:28:54Z',
'fuel_type': 'diesel',
'id': 'a9863d42-1734-5be2-8449-577de5f6f868',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP21503',
'listing': 'auction',
'location': 'FR',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 97710,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_422d119d4071287762bc2bac5d8d5bff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_f44e51519666ba10896b4b63a2fabb39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8f5dc8df2fc8dacd7cda8f48e79ae72a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_fb145b6acffaf1ac00bbab9082b93892.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_a325c0f72d17963b5f1fc26d21ed851e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_8573b1b1be19cd995f52f1b262920b05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_07a2a39db2700e9705517b6bf24e6f63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_44144c1828cf8d3e3db84fcb954a7c3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_d4365d8e9ec08121594586557fbd1139.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_c4f4e167f9274b58a723080a35622344.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_bb9ade1b9e0d23ab176f5e63ed8dca25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5a7e1f7a9067bc90b1e777e9bdeefba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b7674d4ddb3a3e28c97fe3a0a6363ef4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_5e69d5880e1ba83ac962e1289bfe8333.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_00ce86bd2cd2b0f6781efd941ae1954d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33615,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_aa985313405789894e4720980cf74d4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18518,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_e368d477e782f9728aba6fafdef77267.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23720,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b5814958945abc7fbcdf371c7a5d5608.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19196,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_b4dac898015851d125ee7c6ade9f8fd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9863d42-1734-5be2-8449-577de5f6f868/a9863d42-1734-5be2-8449-577de5f6f868_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 27228,
'Height': 369,
'OriginUrl': 'https://img-pa.auto1.com/img1e/fe/1efe1f19ea7f1b71bc6c1816fffc6019/pa/JP21503_67306815fe2f502dd21c3922a005edbf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 2.0 M-Jet Trailhawk 4WD',
'transmission': 'automatic',
'trim': 'Trailhawk 4WD',
'year': 2017}
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP21503%27 HTTP/1.1" 200 None
2025-12-05 17:11:45 [auto1.fr] INFO: Saving data for JP21503: {'created_time': 1764954705.56072, 'last_price_update_time': 1764954705.560729, 'auction_closing_time': 1765038534.0}
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP21503') HTTP/1.1" 204 0
2025-12-05 17:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW91443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1d290>
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_5e2c8409502898eca567434accdcc56a.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5e2c8409502898eca567434accdcc56a.jpg saved to cache
2025-12-05 17:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582b850>
2025-12-05 17:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_5c0950bb6e85e06984fd7ccdb4333fa6.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5c0950bb6e85e06984fd7ccdb4333fa6.jpg saved to cache
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c49e10>
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd9%252Fafd9117898d3a8b6cd45c576ba76d187%252Fpa%252FPW42615_860b818058683d4c7745dec2a8aa03fd.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_860b818058683d4c7745dec2a8aa03fd.jpg saved to cache
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0de85ac-a084-5629-b130-7e001f720132
2025-12-05 17:11:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0de85ac-a084-5629-b130-7e001f720132, skipping ID generation
2025-12-05 17:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0de85ac-a084-5629-b130-7e001f720132 with scrape type 1
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a0de85ac-a084-5629-b130-7e001f720132 from tracking dictionaries
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0de85ac-a084-5629-b130-7e001f720132 sending to next pipeline
2025-12-05 17:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0de85ac-a084-5629-b130-7e001f720132, identifier: PW42615
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5810a90>
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F75%252F8b752d0dfa740cc94c83bef66814faa5%252Fpa%252FAM97121_7d3d45b81570eb85aaa40e11a1b954ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7d3d45b81570eb85aaa40e11a1b954ed.jpg saved to cache
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a11e4b4-4222-547e-81f1-13663ce38dbe
2025-12-05 17:11:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a11e4b4-4222-547e-81f1-13663ce38dbe, skipping ID generation
2025-12-05 17:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a11e4b4-4222-547e-81f1-13663ce38dbe with scrape type 1
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a11e4b4-4222-547e-81f1-13663ce38dbe from tracking dictionaries
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a11e4b4-4222-547e-81f1-13663ce38dbe sending to next pipeline
2025-12-05 17:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a11e4b4-4222-547e-81f1-13663ce38dbe, identifier: AM97121
2025-12-05 17:11:46 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:11:46 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:11:46 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:11:46 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fdb50>
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_15.png HTTP/1.1" 201 0
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_c1d426c6383085f67e38189372e7da72.png') HTTP/1.1" 204 0
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png saved to cache
2025-12-05 17:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4a890>
2025-12-05 17:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_913414bfaa5c4051dd570e149d8a50b2.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg saved to cache
2025-12-05 17:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0de85ac-a084-5629-b130-7e001f720132 with identifier: PW42615
2025-12-05 17:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0de85ac-a084-5629-b130-7e001f720132 with identifier: PW42615
2025-12-05 17:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152391 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152391
2025-12-05 17:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a0de85ac-a084-5629-b130-7e001f720132 spider: auto1.fr
2025-12-05 17:11:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a0de85ac-a084-5629-b130-7e001f720132 due to rule: high_mileage_for_country.json, error: 152391 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
152391
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2025-12-06T16:35:10Z',
'fuel_type': 'diesel',
'id': 'a0de85ac-a084-5629-b130-7e001f720132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW42615',
'listing': 'auction',
'location': 'FR, Saint-Quentin',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 152391,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_860b818058683d4c7745dec2a8aa03fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_fa89f0795bbc146f2e18d25a0a29d23a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_40288b781c5a5dcf8bd81fe30a20c5d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_4b5aaac98a74842b9c870e50431d530e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e32edaea64a5d40af28caced5ffccb78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_458f97bec336f9b874775da90cd1a8cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_efe48d258bbdd1f898085295e578d66e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_485316191b7ff0d026094a16c116ba4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_72a91d96a57abf604164c220c6f37892.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_1985e5a2a519c4918656518a1eb8f945.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_5170896a82135b8eecf6ac3d8e1112be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_6c606f337490e60d3209cc47376df8f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_e3da430f4a580bfd7733b4b0c7990330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_288c6185cd67276832d20d55930cd01d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_3c142fc6c659c8a34b32233b47bbdecb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0de85ac-a084-5629-b130-7e001f720132/a0de85ac-a084-5629-b130-7e001f720132_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/d9/afd9117898d3a8b6cd45c576ba76d187/pa/PW42615_29bb260e1b1df7afc356186f009328da.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Executive',
'transmission': 'automatic',
'trim': '4Matic Executive',
'year': 2017}
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW42615%27 HTTP/1.1" 200 None
2025-12-05 17:11:47 [auto1.fr] INFO: Saving data for PW42615: {'created_time': 1764954707.445464, 'last_price_update_time': 1764954707.445474, 'auction_closing_time': 1765038910.0}
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW42615') HTTP/1.1" 204 0
2025-12-05 17:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a11e4b4-4222-547e-81f1-13663ce38dbe with identifier: AM97121
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2025-12-05 17:11:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 17:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a11e4b4-4222-547e-81f1-13663ce38dbe with identifier: AM97121
2025-12-05 17:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154633 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154633
2025-12-05 17:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3a11e4b4-4222-547e-81f1-13663ce38dbe spider: auto1.fr
2025-12-05 17:11:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3a11e4b4-4222-547e-81f1-13663ce38dbe due to rule: high_mileage_for_country.json, error: 154633 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
154633
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'purple',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:01:03Z',
'fuel_type': 'diesel',
'id': '3a11e4b4-4222-547e-81f1-13663ce38dbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM97121',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 154633,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_581ec544ab1d5cdbb87c429a99341910.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7d3d45b81570eb85aaa40e11a1b954ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_437aeb5227ea0226375d381733e41ad6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5c0950bb6e85e06984fd7ccdb4333fa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_5e2c8409502898eca567434accdcc56a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_a4647f1546f847fc7edda06290ffbae4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_20e97fa2e4dff5520d0d251cf774fb22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_978642c5c3cc62d1bf0b4523a2ac08a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_1c446a1d72dffb3b72924e8853b44632.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f3dd1d2eeb897a574b53de86ef6683cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_7e744b86125f62b7b57070940508f182.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_2be7f98306ac6768de96f5e4614ea446.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_22017ce580a8125c7c0aa1009980d314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_387b5db1b5a9fdae68c5a85f4ed98423.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c64e71981b6558e1e1aab839b615e98d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_407763e6eb155f3ba64497469e262df5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_c3a914012e263ba058dd2e6622bd86b3.jpg',
'Width': 553},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20932,
'Height': 239,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_f01e860e3700f96e5723696acdbdd5f9.jpg',
'Width': 623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_fe573b259f705b5584f604677ed847a6.jpg',
'Width': 769},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a11e4b4-4222-547e-81f1-13663ce38dbe/3a11e4b4-4222-547e-81f1-13663ce38dbe_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21941,
'Height': 319,
'OriginUrl': 'https://img-pa.auto1.com/img8b/75/8b752d0dfa740cc94c83bef66814faa5/pa/AM97121_0f742f5704edadc5fa1fd5a4d3a71000.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2016}
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM97121%27 HTTP/1.1" 200 None
2025-12-05 17:11:47 [auto1.fr] INFO: Saving data for AM97121: {'created_time': 1764954707.840588, 'last_price_update_time': 1764954707.8406, 'auction_closing_time': 1765036863.0}
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AM97121') HTTP/1.1" 204 0
2025-12-05 17:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW12651> (referer: https://www.auto1.com/v1/car-details-view/WW12651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c583ec10>
2025-12-05 17:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg saved to cache
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5905390>
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_73a8f752c522b62a50be91e3f4b23df3.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg saved to cache
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a65190>
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_472c7f5b526d56e54c463189c93c0675.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg saved to cache
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d with identifier: WW12651
2025-12-05 17:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d with scrape type 2
2025-12-05 17:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d with scrape type 2
2025-12-05 17:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d, identifier: WW12651
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b64fd0>
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg saved to cache
2025-12-05 17:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d with identifier: WW12651
2025-12-05 17:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d with identifier: WW12651
2025-12-05 17:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d with identifier: WW12651 to the API
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW12651>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2025-12-06T16:40:14Z',
'fuel_type': 'gas',
'id': 'aa3e1fc5-a65a-5d46-a0ea-cda2ef0b1f5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW12651',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 18295,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2020}
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW12651%27 HTTP/1.1" 200 None
2025-12-05 17:11:49 [auto1.fr] INFO: Saving data for WW12651: {'auction_closing_time': 1765039214.0, 'created_time': 1764350007.990054, 'last_price_update_time': 1764954709.301243}
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WW12651') HTTP/1.1" 204 0
2025-12-05 17:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5880810>
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg saved to cache
2025-12-05 17:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb1e10>
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_1315ff305c7f499eee810036fb06be82.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg saved to cache
2025-12-05 17:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5782fd0>
2025-12-05 17:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F36%252F1d36c8c936e085257c9a8e4dbb31ae46%252Fpa%252FHB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg saved to cache
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34
2025-12-05 17:11:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34, skipping ID generation
2025-12-05 17:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 with scrape type 1
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 from tracking dictionaries
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 sending to next pipeline
2025-12-05 17:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34, identifier: HB93630
2025-12-05 17:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_5991b584677989de0a58429b8b94cdfc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 with identifier: HB93630
2025-12-05 17:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 with identifier: HB93630
2025-12-05 17:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 19, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 98318, 'odometer_reading_unit': 'km', 'registration_date': '2016-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb93630', 'expiration_date': '2025-12-06t16:12:26z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '75d3ce66-adcf-5dfb-8074-d1df7ae5ca34', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55156}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83475}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48637}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 44688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81094}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61649}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65580}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91959}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20418}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20878}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20791}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 18666}], 'current_year_diff': 9, 'age_in_months': 113, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 98318}
Failed validating None in schema:
False
On instance:
{'age_in_months': 113,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:12:26z',
'fuel_type': 'petrol',
'id': '75d3ce66-adcf-5dfb-8074-d1df7ae5ca34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb93630',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 98318,
'odometer_in_km': 98318,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2016}
2025-12-05 17:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 spider: auto1.fr
2025-12-05 17:11:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 75d3ce66-adcf-5dfb-8074-d1df7ae5ca34 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 19, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 98318, 'odometer_reading_unit': 'km', 'registration_date': '2016-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb93630', 'expiration_date': '2025-12-06t16:12:26z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '75d3ce66-adcf-5dfb-8074-d1df7ae5ca34', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55156}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83475}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 48637}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 90802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 44688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81094}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61649}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65580}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 91959}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20418}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_16.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20878}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_17.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 20791}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_18.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg', 'Width': 270, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 18666}], 'current_year_diff': 9, 'age_in_months': 113, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 98318}
Failed validating None in schema:
False
On instance:
{'age_in_months': 113,
'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:12:26z',
'fuel_type': 'petrol',
'id': '75d3ce66-adcf-5dfb-8074-d1df7ae5ca34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hb93630',
'listing': 'auction',
'location': 'fr',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 98318,
'odometer_in_km': 98318,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-26',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech allure',
'transmission': 'automatic',
'trim': 'allure',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:12:26Z',
'fuel_type': 'petrol',
'id': '75d3ce66-adcf-5dfb-8074-d1df7ae5ca34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB93630',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '2008',
'odometer': 98318,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1315ff305c7f499eee810036fb06be82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_fd818912e500516ef56b352503b9b3a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_0cd69be58da6410ca39f9e3b084b21b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3da312ac871cdd5f308b56e932ee1b5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7db1ad53913bbb68bb74a3b6b7a30ac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_472c7f5b526d56e54c463189c93c0675.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_e79f7728faee1a850afc1dfe8f348cef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_06c19b3894bd76000edb8e2f4440fa0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_1141df6d900f1ba6bcdc49a1e1c54d07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_11a234fdbeda93ea369e99665bd41f59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_25378f13419d0104060ce2fbc3994fe5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_ccace15c7c73fe4faf1a8459738c1441.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_4340e4e62afb700b201abb8704e0da34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_63ee9e80f249694303e4c271c3229dde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_a5fcb3c17f5d4f5c2a5b5f833c8c83c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_46346ed9d4a6f3a8c6382753523bbd14.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_3837217e11deb91a4990b63dbddc5a3b.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_7c0f0e147edfc6b33e275cb647712844.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75d3ce66-adcf-5dfb-8074-d1df7ae5ca34/75d3ce66-adcf-5dfb-8074-d1df7ae5ca34_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/36/1d36c8c936e085257c9a8e4dbb31ae46/pa/HB93630_53076e24f55b9bc29c4be9c1e6ad1a46.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB93630%27 HTTP/1.1" 200 None
2025-12-05 17:11:50 [auto1.fr] INFO: Saving data for HB93630: {'created_time': 1764954710.426201, 'last_price_update_time': 1764954710.426212, 'auction_closing_time': 1765037546.0}
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HB93630') HTTP/1.1" 204 0
2025-12-05 17:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_236f0297727763252001ccecc8746607.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW91443> (referer: https://www.auto1.com/v1/car-details-view/EW91443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c790dd90>
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_5991b584677989de0a58429b8b94cdfc.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_5991b584677989de0a58429b8b94cdfc.jpg saved to cache
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_440f81ef60461390754852a512f24fd0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_af32e45ee960fde2846f41da950dfddc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd59d0>
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_236f0297727763252001ccecc8746607.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_236f0297727763252001ccecc8746607.jpg saved to cache
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b61eafdf-9830-54b5-a605-38861df4e22a with identifier: EW91443
2025-12-05 17:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b61eafdf-9830-54b5-a605-38861df4e22a with scrape type 2
2025-12-05 17:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b61eafdf-9830-54b5-a605-38861df4e22a with scrape type 2
2025-12-05 17:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b61eafdf-9830-54b5-a605-38861df4e22a, identifier: EW91443
2025-12-05 17:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b61eafdf-9830-54b5-a605-38861df4e22a with identifier: EW91443
2025-12-05 17:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b61eafdf-9830-54b5-a605-38861df4e22a with identifier: EW91443
2025-12-05 17:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170244 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170244
2025-12-05 17:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b61eafdf-9830-54b5-a605-38861df4e22a spider: auto1.fr
2025-12-05 17:11:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b61eafdf-9830-54b5-a605-38861df4e22a due to rule: high_mileage_for_country.json, error: 170244 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
170244
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': 'Taxi',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:26:52Z',
'fuel_type': 'diesel',
'id': 'b61eafdf-9830-54b5-a605-38861df4e22a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW91443',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 170244,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW91443%27 HTTP/1.1" 200 None
2025-12-05 17:11:51 [auto1.fr] INFO: Saving data for EW91443: {'auction_closing_time': 1765038412.0, 'created_time': 1763659121.680333, 'last_price_update_time': 1764954711.22694}
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW91443') HTTP/1.1" 204 0
2025-12-05 17:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3589f49e0ab5c30e86935f6defd155c1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_79ec583cf4ba7222e4d7af7b48bee66b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_aa4aecd7e32ad68731d12e608b00a834.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c8590>
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_440f81ef60461390754852a512f24fd0.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_440f81ef60461390754852a512f24fd0.jpg saved to cache
2025-12-05 17:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de1c90>
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_af32e45ee960fde2846f41da950dfddc.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_af32e45ee960fde2846f41da950dfddc.jpg saved to cache
2025-12-05 17:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b67b50>
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg saved to cache
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_63338b8673103252d91965dda4101979.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5810090>
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_3589f49e0ab5c30e86935f6defd155c1.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3589f49e0ab5c30e86935f6defd155c1.jpg saved to cache
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfc990>
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_79ec583cf4ba7222e4d7af7b48bee66b.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_79ec583cf4ba7222e4d7af7b48bee66b.jpg saved to cache
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfeb90>
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_aa4aecd7e32ad68731d12e608b00a834.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_aa4aecd7e32ad68731d12e608b00a834.jpg saved to cache
2025-12-05 17:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3d84bd530bac3cda62dc1c60cba254d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_abd411714f735847c17d6f1b88287ed3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57d53d0>
2025-12-05 17:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_63338b8673103252d91965dda4101979.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_63338b8673103252d91965dda4101979.jpg saved to cache
2025-12-05 17:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3499781d66d0db589f039ea1e2a5b22b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_fb07cdce8f0d444649240cd746eb0056.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_4bb7ef012caff56745521dfab9281c2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_08d8040692b071ea86a6be8346fd51bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_ec0b6ebdad6ddc2d279a18deee67e156.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6276c4855e7196e745213400c4a06d52.png> (referer: https://www.auto1.com/)
2025-12-05 17:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4ee90>
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg saved to cache
2025-12-05 17:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58de3d0>
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg saved to cache
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4df6710>
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_eb8aa32793825d58eca216d853e3222d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg saved to cache
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4efc390>
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_3d84bd530bac3cda62dc1c60cba254d6.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3d84bd530bac3cda62dc1c60cba254d6.jpg saved to cache
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4d5d0>
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_abd411714f735847c17d6f1b88287ed3.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_abd411714f735847c17d6f1b88287ed3.jpg saved to cache
2025-12-05 17:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4c590>
2025-12-05 17:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg saved to cache
2025-12-05 17:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59af210>
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F1a%252F501a3a01d67fc030a94adae2dd98b8f6%252Fpa%252FRH90970_e63e184cb21dbb16e950e307f0c45abb.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg saved to cache
2025-12-05 17:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86e1064a-340b-5930-a422-3ec24e804648
2025-12-05 17:11:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86e1064a-340b-5930-a422-3ec24e804648, skipping ID generation
2025-12-05 17:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86e1064a-340b-5930-a422-3ec24e804648 with scrape type 1
2025-12-05 17:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 86e1064a-340b-5930-a422-3ec24e804648 from tracking dictionaries
2025-12-05 17:11:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86e1064a-340b-5930-a422-3ec24e804648 sending to next pipeline
2025-12-05 17:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 86e1064a-340b-5930-a422-3ec24e804648, identifier: RH90970
2025-12-05 17:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 86e1064a-340b-5930-a422-3ec24e804648 with identifier: RH90970
2025-12-05 17:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 86e1064a-340b-5930-a422-3ec24e804648 with identifier: RH90970
2025-12-05 17:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech crossway', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 111111, 'odometer_reading_unit': 'km', 'registration_date': '2019-08-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh90970', 'expiration_date': '2025-12-06t16:35:23z', 'origin_country_code': 'fr', 'trim': 'crossway', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, agen', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '86e1064a-340b-5930-a422-3ec24e804648', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70840}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2426774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2340373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2330621}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2408957}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2352896}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2383586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2169728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2520510}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2677039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2510775}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2495240}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 108701}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 77754}], 'current_year_diff': 6, 'age_in_months': 75, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 111111}
Failed validating None in schema:
False
On instance:
{'age_in_months': 75,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:35:23z',
'fuel_type': 'petrol',
'id': '86e1064a-340b-5930-a422-3ec24e804648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh90970',
'listing': 'auction',
'location': 'fr, agen',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 111111,
'odometer_in_km': 111111,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426774,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340373,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2330621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408957,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2352896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383586,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169728,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2520510,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677039,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510775,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495240,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77754,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech crossway',
'transmission': 'automatic',
'trim': 'crossway',
'year': 2019}
2025-12-05 17:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 86e1064a-340b-5930-a422-3ec24e804648 spider: auto1.fr
2025-12-05 17:11:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 86e1064a-340b-5930-a422-3ec24e804648 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech crossway', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 111111, 'odometer_reading_unit': 'km', 'registration_date': '2019-08-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh90970', 'expiration_date': '2025-12-06t16:35:23z', 'origin_country_code': 'fr', 'trim': 'crossway', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, agen', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '86e1064a-340b-5930-a422-3ec24e804648', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70840}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2426774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2340373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2330621}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2408957}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2352896}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2383586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2169728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2520510}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2677039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2510775}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2495240}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 108701}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 77754}], 'current_year_diff': 6, 'age_in_months': 75, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 111111}
Failed validating None in schema:
False
On instance:
{'age_in_months': 75,
'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 131,
'expiration_date': '2025-12-06t16:35:23z',
'fuel_type': 'petrol',
'id': '86e1064a-340b-5930-a422-3ec24e804648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rh90970',
'listing': 'auction',
'location': 'fr, agen',
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 111111,
'odometer_in_km': 111111,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426774,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340373,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2330621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408957,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2352896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383586,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169728,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2520510,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677039,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510775,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495240,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77754,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 1.2 puretech crossway',
'transmission': 'automatic',
'trim': 'crossway',
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:35:23Z',
'fuel_type': 'petrol',
'id': '86e1064a-340b-5930-a422-3ec24e804648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH90970',
'listing': 'auction',
'location': 'FR, Agen',
'make': 'Peugeot',
'model': '2008',
'odometer': 111111,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_5efd420892f6e9aaa33438ca3d1a2aed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_73a8f752c522b62a50be91e3f4b23df3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426774,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_e63e184cb21dbb16e950e307f0c45abb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340373,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_eb8aa32793825d58eca216d853e3222d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2330621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_8692104914808dee2f9c96cc461d821e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408957,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_a412236d2c7c74c66f5fbdb51227cf64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2352896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_cbbedf9fc9312cfc12057c4eff2ab820.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383586,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c3bd260473e88bfce2c9b80e71e0108.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169728,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_42ccc46fbf271e0ac5bb65cdfdbcbf64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2520510,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_abe3ab5400662cacb4dbfda8fdaf1d9f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677039,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_60bbd02009c6431baa6536ad78f6cf7b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510775,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_595d28438cd898af7708f52fb957d865.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_913414bfaa5c4051dd570e149d8a50b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495240,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_882e7ca14b7efbaf7e2e63fcc95e917f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_6c668cf5818af4cad56d9ffacaa88aa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86e1064a-340b-5930-a422-3ec24e804648/86e1064a-340b-5930-a422-3ec24e804648_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 77754,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img50/1a/501a3a01d67fc030a94adae2dd98b8f6/pa/RH90970_c1d426c6383085f67e38189372e7da72.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Crossway',
'transmission': 'automatic',
'trim': 'Crossway',
'year': 2019}
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH90970%27 HTTP/1.1" 200 None
2025-12-05 17:11:56 [auto1.fr] INFO: Saving data for RH90970: {'created_time': 1764954716.028186, 'last_price_update_time': 1764954716.028196, 'auction_closing_time': 1765038923.0}
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RH90970') HTTP/1.1" 204 0
2025-12-05 17:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_e289a22e8c1e6909bd92d6793191d448.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_a7f16300e6b5ddb3e3d7a084d175a073.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_c2ea34db11ad9aeca93199131d7f4e47.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ad990>
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_3499781d66d0db589f039ea1e2a5b22b.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3499781d66d0db589f039ea1e2a5b22b.jpg saved to cache
2025-12-05 17:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5813710>
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_fb07cdce8f0d444649240cd746eb0056.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_fb07cdce8f0d444649240cd746eb0056.jpg saved to cache
2025-12-05 17:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d5c590>
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_4bb7ef012caff56745521dfab9281c2f.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_4bb7ef012caff56745521dfab9281c2f.jpg saved to cache
2025-12-05 17:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c94e90>
2025-12-05 17:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_08d8040692b071ea86a6be8346fd51bd.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_08d8040692b071ea86a6be8346fd51bd.jpg saved to cache
2025-12-05 17:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ac91d0>
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_ec0b6ebdad6ddc2d279a18deee67e156.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_ec0b6ebdad6ddc2d279a18deee67e156.jpg saved to cache
2025-12-05 17:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:57 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:11:57 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:11:57 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dff810>
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_9.png HTTP/1.1" 201 0
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_6276c4855e7196e745213400c4a06d52.png') HTTP/1.1" 204 0
2025-12-05 17:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6276c4855e7196e745213400c4a06d52.png saved to cache
2025-12-05 17:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6d0f9abed15498cedb946164fefb299d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f8ef2a9b71551bf63276afdc1a426531.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f3df74d7bab773ec37ac2b287b4359f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_2f55f67ed2bc654c248625bc955c96b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_8bf4ecc002eb4325b3048a6e50b59945.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_3f54343a3b63b44e95d163290e8d64de.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5829f10>
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_e289a22e8c1e6909bd92d6793191d448.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_e289a22e8c1e6909bd92d6793191d448.jpg saved to cache
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578bd50>
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_a7f16300e6b5ddb3e3d7a084d175a073.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_a7f16300e6b5ddb3e3d7a084d175a073.jpg saved to cache
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e65d10>
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fcf%252F5ccfb118ce3d490feccd643934bc1446%252Fpa%252FAD24281_c2ea34db11ad9aeca93199131d7f4e47.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_c2ea34db11ad9aeca93199131d7f4e47.jpg saved to cache
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4
2025-12-05 17:11:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b991d255-54c9-5fb4-8d7c-3ac507cc17b4, skipping ID generation
2025-12-05 17:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4 with scrape type 1
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b991d255-54c9-5fb4-8d7c-3ac507cc17b4 from tracking dictionaries
2025-12-05 17:11:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b991d255-54c9-5fb4-8d7c-3ac507cc17b4 sending to next pipeline
2025-12-05 17:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b991d255-54c9-5fb4-8d7c-3ac507cc17b4, identifier: AD24281
2025-12-05 17:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b991d255-54c9-5fb4-8d7c-3ac507cc17b4 with identifier: AD24281
2025-12-05 17:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b991d255-54c9-5fb4-8d7c-3ac507cc17b4 with identifier: AD24281
2025-12-05 17:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2025-12-05 17:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b991d255-54c9-5fb4-8d7c-3ac507cc17b4 spider: auto1.fr
2025-12-05 17:11:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b991d255-54c9-5fb4-8d7c-3ac507cc17b4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:56:54Z',
'fuel_type': 'diesel',
'id': 'b991d255-54c9-5fb4-8d7c-3ac507cc17b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD24281',
'listing': 'auction',
'location': 'Chambray-Lès-Tours',
'make': 'Opel',
'model': 'Combo',
'odometer': 157338,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_c2ea34db11ad9aeca93199131d7f4e47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_ec0b6ebdad6ddc2d279a18deee67e156.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_08d8040692b071ea86a6be8346fd51bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_4bb7ef012caff56745521dfab9281c2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3499781d66d0db589f039ea1e2a5b22b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_abd411714f735847c17d6f1b88287ed3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3d84bd530bac3cda62dc1c60cba254d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_63338b8673103252d91965dda4101979.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_aa4aecd7e32ad68731d12e608b00a834.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_79ec583cf4ba7222e4d7af7b48bee66b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_3589f49e0ab5c30e86935f6defd155c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_440f81ef60461390754852a512f24fd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_af32e45ee960fde2846f41da950dfddc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_5991b584677989de0a58429b8b94cdfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_236f0297727763252001ccecc8746607.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b991d255-54c9-5fb4-8d7c-3ac507cc17b4/b991d255-54c9-5fb4-8d7c-3ac507cc17b4_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 102072,
'Height': 430,
'OriginUrl': 'https://img-pa.auto1.com/img5c/cf/5ccfb118ce3d490feccd643934bc1446/pa/AD24281_d067bbb1a436f8d9a68909074a0fa32f.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-26',
'seats_number': 2,
'seller_name': None,
'title': 'Opel Combo 1.5 CDTI Pack Business Augmenté L1H1',
'transmission': 'manual',
'trim': 'Pack Business Augmenté L1H1',
'year': 2019}
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD24281%27 HTTP/1.1" 200 None
2025-12-05 17:11:58 [auto1.fr] INFO: Saving data for AD24281: {'created_time': 1764954718.772557, 'last_price_update_time': 1764954718.772566, 'auction_closing_time': 1765040214.0}
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AD24281') HTTP/1.1" 204 0
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a64b90>
2025-12-05 17:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_6d0f9abed15498cedb946164fefb299d.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6d0f9abed15498cedb946164fefb299d.jpg saved to cache
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dee7d0>
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_f8ef2a9b71551bf63276afdc1a426531.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f8ef2a9b71551bf63276afdc1a426531.jpg saved to cache
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59642d0>
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_f3df74d7bab773ec37ac2b287b4359f2.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f3df74d7bab773ec37ac2b287b4359f2.jpg saved to cache
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea2a90>
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_2f55f67ed2bc654c248625bc955c96b9.jpg') HTTP/1.1" 204 0
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_2f55f67ed2bc654c248625bc955c96b9.jpg saved to cache
2025-12-05 17:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d08b10>
2025-12-05 17:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_8bf4ecc002eb4325b3048a6e50b59945.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_8bf4ecc002eb4325b3048a6e50b59945.jpg saved to cache
2025-12-05 17:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5927290>
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F91%252F09914849ebcde923dd1f6bf6b22499dd%252Fpa%252FZG03481_3f54343a3b63b44e95d163290e8d64de.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_3f54343a3b63b44e95d163290e8d64de.jpg saved to cache
2025-12-05 17:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dea6c1e-d272-5031-9765-f184907e6a07
2025-12-05 17:12:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dea6c1e-d272-5031-9765-f184907e6a07, skipping ID generation
2025-12-05 17:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dea6c1e-d272-5031-9765-f184907e6a07 with scrape type 1
2025-12-05 17:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0dea6c1e-d272-5031-9765-f184907e6a07 from tracking dictionaries
2025-12-05 17:12:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dea6c1e-d272-5031-9765-f184907e6a07 sending to next pipeline
2025-12-05 17:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0dea6c1e-d272-5031-9765-f184907e6a07, identifier: ZG03481
2025-12-05 17:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0dea6c1e-d272-5031-9765-f184907e6a07 with identifier: ZG03481
2025-12-05 17:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0dea6c1e-d272-5031-9765-f184907e6a07 with identifier: ZG03481
2025-12-05 17:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0dea6c1e-d272-5031-9765-f184907e6a07 with identifier: ZG03481 to the API
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_3f54343a3b63b44e95d163290e8d64de.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:52:01Z',
'fuel_type': 'hybrid',
'id': '0dea6c1e-d272-5031-9765-f184907e6a07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG03481',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '3008',
'odometer': 63730,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93562,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f8ef2a9b71551bf63276afdc1a426531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89212,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_3f54343a3b63b44e95d163290e8d64de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87917,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6d0f9abed15498cedb946164fefb299d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93057,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_8bf4ecc002eb4325b3048a6e50b59945.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87548,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_2f55f67ed2bc654c248625bc955c96b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86810,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_f3df74d7bab773ec37ac2b287b4359f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63573,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_a7f16300e6b5ddb3e3d7a084d175a073.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54711,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_e289a22e8c1e6909bd92d6793191d448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51314,
'Height': 452,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_fb07cdce8f0d444649240cd746eb0056.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dea6c1e-d272-5031-9765-f184907e6a07/0dea6c1e-d272-5031-9765-f184907e6a07_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img09/91/09914849ebcde923dd1f6bf6b22499dd/pa/ZG03481_6276c4855e7196e745213400c4a06d52.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2020}
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG03481%27 HTTP/1.1" 200 None
2025-12-05 17:12:00 [auto1.fr] INFO: Saving data for ZG03481: {'created_time': 1764954720.772839, 'last_price_update_time': 1764954720.772852, 'auction_closing_time': 1765039921.0}
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG03481') HTTP/1.1" 204 0
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC29401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ88026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU89750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR77769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM43715/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE93344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX17937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB21305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP46513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF22737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC31591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC70892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW87176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR74460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:06 [auto1.fr] INFO: Parsing search results for channel: 24h
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: AN83141
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN83141%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for AN83141: 0
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: AJ29872
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ29872%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for AJ29872: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: AV43690
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43690%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for AV43690: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: NH44309
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH44309%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for NH44309: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: BG92897
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG92897%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for BG92897: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: JK31010
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK31010%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for JK31010: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: XG91687
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG91687%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for XG91687: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: EB82466
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB82466%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for EB82466: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: CY84245
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY84245%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for CY84245: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: RK18215
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK18215%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for RK18215: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: AG30876
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG30876%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for AG30876: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: JG57879
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG57879%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for JG57879: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: ZT75238
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT75238%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for ZT75238: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: UY74094
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY74094%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for UY74094: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: FP22494
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP22494%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for FP22494: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: VY56716
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY56716%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for VY56716: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: KU18069
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU18069%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for KU18069: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: DF07969
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF07969%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for DF07969: 1
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: US26255
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US26255%27 HTTP/1.1" 200 None
2025-12-05 17:12:06 [auto1.fr] INFO: Scrape type for US26255: 2
2025-12-05 17:12:06 [auto1.fr] INFO: Found listing with ID: LU28181
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU28181%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for LU28181: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: TX56394
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX56394%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for TX56394: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: MX72651
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX72651%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for MX72651: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: ZP73436
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP73436%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for ZP73436: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: UT03578
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT03578%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for UT03578: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: YT75672
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT75672%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for YT75672: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: HL16810
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL16810%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for HL16810: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: NF47019
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF47019%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for NF47019: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: BU62018
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU62018%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for BU62018: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: GY85660
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY85660%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for GY85660: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: MC12795
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC12795%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for MC12795: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: DE79123
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE79123%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for DE79123: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: XM52507
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM52507%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for XM52507: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: MM88869
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM88869%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for MM88869: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: SR88466
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR88466%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for SR88466: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: JD81006
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD81006%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for JD81006: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: UN83109
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN83109%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for UN83109: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: MT91443
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT91443%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for MT91443: 2
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: RX01417
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX01417%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for RX01417: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: UD64231
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD64231%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for UD64231: 1
2025-12-05 17:12:07 [auto1.fr] INFO: Found listing with ID: NC37303
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC37303%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [auto1.fr] INFO: Scrape type for NC37303: 2
2025-12-05 17:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU89750> (referer: https://www.auto1.com/v1/car-details-view/PU89750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2 with identifier: PU89750
2025-12-05 17:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2 with scrape type 1
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_4fb73e3624ac083d6eb4c66d7cdbb3a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_4fb73e3624ac083d6eb4c66d7cdbb3a4.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_cb47860bce2d514232c1b200f156c471.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_cb47860bce2d514232c1b200f156c471.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_bda8b9d2bf6239ef98941901a82b2443.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_bda8b9d2bf6239ef98941901a82b2443.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_1061a633260373c692813953f3412bad.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_1061a633260373c692813953f3412bad.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_833e7fb429d780a404b030a940689d17.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_833e7fb429d780a404b030a940689d17.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_012c812e3ed936b7414aaeffdcf66fba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_012c812e3ed936b7414aaeffdcf66fba.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_b6fd068f879216a58c5ea0b39cea7b52.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_b6fd068f879216a58c5ea0b39cea7b52.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_d62b0c325213331b253960cad77f082c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_d62b0c325213331b253960cad77f082c.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_03f9285bce03d4a954bfeba0afb5e551.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_03f9285bce03d4a954bfeba0afb5e551.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_f3674a0bfc7d9b0973475f113cc270cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_f3674a0bfc7d9b0973475f113cc270cc.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_b8143880a635dbe1ef9a0aae3d808f36.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_b8143880a635dbe1ef9a0aae3d808f36.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_6e087ab3e5409876824ade6d484fe0aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_6e087ab3e5409876824ade6d484fe0aa.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_c7b313213b53475afb57f5a8fe47b79d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_c7b313213b53475afb57f5a8fe47b79d.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_12b0b166c5c94d0e88fccc5eace4edf1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_12b0b166c5c94d0e88fccc5eace4edf1.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_0019a6a20474da3209a70f44598470e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_0019a6a20474da3209a70f44598470e4.jpg already downloaded
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fc8%252F38c88bf4554f385530dd84752f75dce9%252Fpa%252FPU89750_971db967b95e5606f322ed5ceffb2671.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_971db967b95e5606f322ed5ceffb2671.jpg already downloaded
2025-12-05 17:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2, identifier: PU89750
2025-12-05 17:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2 with identifier: PU89750
2025-12-05 17:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2 with identifier: PU89750
2025-12-05 17:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2 with identifier: PU89750 to the API
2025-12-05 17:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU89750>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 252,
'expiration_date': '2025-12-06T16:02:36Z',
'fuel_type': 'petrol',
'id': 'e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU89750',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'BMW',
'model': '5er',
'odometer': 95603,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_4fb73e3624ac083d6eb4c66d7cdbb3a4.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_cb47860bce2d514232c1b200f156c471.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_bda8b9d2bf6239ef98941901a82b2443.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_1061a633260373c692813953f3412bad.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_833e7fb429d780a404b030a940689d17.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_012c812e3ed936b7414aaeffdcf66fba.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_b6fd068f879216a58c5ea0b39cea7b52.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_d62b0c325213331b253960cad77f082c.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_03f9285bce03d4a954bfeba0afb5e551.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_f3674a0bfc7d9b0973475f113cc270cc.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_b8143880a635dbe1ef9a0aae3d808f36.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_6e087ab3e5409876824ade6d484fe0aa.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_c7b313213b53475afb57f5a8fe47b79d.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_12b0b166c5c94d0e88fccc5eace4edf1.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_0019a6a20474da3209a70f44598470e4.jpg',
'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_971db967b95e5606f322ed5ceffb2671.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_4fb73e3624ac083d6eb4c66d7cdbb3a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_cb47860bce2d514232c1b200f156c471.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_bda8b9d2bf6239ef98941901a82b2443.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_1061a633260373c692813953f3412bad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_833e7fb429d780a404b030a940689d17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_012c812e3ed936b7414aaeffdcf66fba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_b6fd068f879216a58c5ea0b39cea7b52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_d62b0c325213331b253960cad77f082c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_03f9285bce03d4a954bfeba0afb5e551.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_f3674a0bfc7d9b0973475f113cc270cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_b8143880a635dbe1ef9a0aae3d808f36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_6e087ab3e5409876824ade6d484fe0aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_c7b313213b53475afb57f5a8fe47b79d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_12b0b166c5c94d0e88fccc5eace4edf1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_0019a6a20474da3209a70f44598470e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2/e5e5a7b0-f6d3-53e1-a14f-cab1dd8924c2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/c8/38c88bf4554f385530dd84752f75dce9/pa/PU89750_971db967b95e5606f322ed5ceffb2671.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530i xDrive Business',
'transmission': 'automatic',
'trim': 'xDrive Business',
'year': 2017}
2025-12-05 17:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU89750%27 HTTP/1.1" 200 None
2025-12-05 17:12:08 [auto1.fr] INFO: Saving data for PU89750: {'created_time': 1764954728.347161, 'last_price_update_time': 1764954728.347171, 'auction_closing_time': 1765036956.0}
2025-12-05 17:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU89750') HTTP/1.1" 204 0
2025-12-05 17:12:08 [scrapy.extensions.logstats] INFO: Crawled 840 pages (at 35 pages/min), scraped 200 items (at 8 items/min)
2025-12-05 17:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP41249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG60875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP46513> (referer: https://www.auto1.com/v1/car-details-view/KP46513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB21305> (referer: https://www.auto1.com/v1/car-details-view/JB21305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a75336-a502-57a0-84e8-1a073383b9a4 with identifier: KP46513
2025-12-05 17:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a75336-a502-57a0-84e8-1a073383b9a4 with scrape type 2
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a75336-a502-57a0-84e8-1a073383b9a4 with scrape type 2
2025-12-05 17:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87a75336-a502-57a0-84e8-1a073383b9a4, identifier: KP46513
2025-12-05 17:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87a75336-a502-57a0-84e8-1a073383b9a4 with identifier: KP46513
2025-12-05 17:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87a75336-a502-57a0-84e8-1a073383b9a4 with identifier: KP46513
2025-12-05 17:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2025-12-05 17:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 87a75336-a502-57a0-84e8-1a073383b9a4 spider: auto1.fr
2025-12-05 17:12:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 87a75336-a502-57a0-84e8-1a073383b9a4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 131,
'expiration_date': '2025-12-06T16:16:46Z',
'fuel_type': 'diesel',
'id': '87a75336-a502-57a0-84e8-1a073383b9a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP46513',
'listing': 'auction',
'location': 'FR',
'make': 'Ford',
'model': 'Transit',
'odometer': 14973,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-01',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 330 L2 Trend Business',
'transmission': 'manual',
'trim': '330 L2 Trend Business',
'year': 2023}
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP46513%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [auto1.fr] INFO: Saving data for KP46513: {'auction_closing_time': 1765037806.0, 'created_time': 1764756100.984531, 'last_price_update_time': 1764954737.782617}
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KP46513') HTTP/1.1" 204 0
2025-12-05 17:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c78480f8-4de2-5255-a62f-a5c88acb7fe1 with identifier: JB21305
2025-12-05 17:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c78480f8-4de2-5255-a62f-a5c88acb7fe1 with scrape type 1
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_d13dcc7bf1845468fdae74cbaadd0c23.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_d13dcc7bf1845468fdae74cbaadd0c23.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_13ed309c02af3be21744a42180ea6925.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_13ed309c02af3be21744a42180ea6925.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_7cca09762e115877cc521247f37f59c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7cca09762e115877cc521247f37f59c4.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_b02cf2e90070a022bbf92572757d0e1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_b02cf2e90070a022bbf92572757d0e1f.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_97a4e1132126138db64829ad352aaf5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_97a4e1132126138db64829ad352aaf5c.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_db5517d39d631de393fe98e117cf6988.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_db5517d39d631de393fe98e117cf6988.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_411558317da2b2a78a42b1f16d93e54a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_411558317da2b2a78a42b1f16d93e54a.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_88f65c72746e24c3b5ad3292ba6a727d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_88f65c72746e24c3b5ad3292ba6a727d.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_23dc4af772a2aa9bbf18cd66cfbd7a25.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_23dc4af772a2aa9bbf18cd66cfbd7a25.jpg not downloaded yet
2025-12-05 17:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_fd6e5547e611a765a95265165faf95b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_fd6e5547e611a765a95265165faf95b6.jpg not downloaded yet
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_679b6df136973825400648132ff372c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_679b6df136973825400648132ff372c9.jpg not downloaded yet
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_7c7bbcf6aeaa5d982c13a799e86e86a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7c7bbcf6aeaa5d982c13a799e86e86a7.jpg not downloaded yet
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_058cd9576800c29ecdca7c7a456a39fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_058cd9576800c29ecdca7c7a456a39fa.jpg not downloaded yet
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_f9fc81f3e3a2f6980717924c2ead5a61.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_f9fc81f3e3a2f6980717924c2ead5a61.jpg not downloaded yet
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_a8b9b8f7a3a2a7a3aaca6f1db1bc4898.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_a8b9b8f7a3a2a7a3aaca6f1db1bc4898.jpg not downloaded yet
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_722d4ad55e79dfffeb9f929d5f97983c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_722d4ad55e79dfffeb9f929d5f97983c.jpg not downloaded yet
2025-12-05 17:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE93344> (referer: https://www.auto1.com/v1/car-details-view/RE93344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c59a10e-8460-59a0-9acb-849afdfd2004 with identifier: RE93344
2025-12-05 17:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c59a10e-8460-59a0-9acb-849afdfd2004 with scrape type 2
2025-12-05 17:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c59a10e-8460-59a0-9acb-849afdfd2004 with scrape type 2
2025-12-05 17:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9c59a10e-8460-59a0-9acb-849afdfd2004, identifier: RE93344
2025-12-05 17:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9c59a10e-8460-59a0-9acb-849afdfd2004 with identifier: RE93344
2025-12-05 17:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9c59a10e-8460-59a0-9acb-849afdfd2004 with identifier: RE93344
2025-12-05 17:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 139415, 'odometer_reading_unit': 'km', 'registration_date': '2016-02-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re93344', 'expiration_date': '2025-12-06t16:16:24z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '9c59a10e-8460-59a0-9acb-849afdfd2004', 'current_year_diff': 9, 'age_in_months': 118, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 139415}
Failed validating None in schema:
False
On instance:
{'age_in_months': 118,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:16:24z',
'fuel_type': 'petrol',
'id': '9c59a10e-8460-59a0-9acb-849afdfd2004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re93344',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 139415,
'odometer_in_km': 139415,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-01',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2016}
2025-12-05 17:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 9c59a10e-8460-59a0-9acb-849afdfd2004 spider: auto1.fr
2025-12-05 17:12:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9c59a10e-8460-59a0-9acb-849afdfd2004 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 139415, 'odometer_reading_unit': 'km', 'registration_date': '2016-02-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re93344', 'expiration_date': '2025-12-06t16:16:24z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '9c59a10e-8460-59a0-9acb-849afdfd2004', 'current_year_diff': 9, 'age_in_months': 118, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 139415}
Failed validating None in schema:
False
On instance:
{'age_in_months': 118,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:16:24z',
'fuel_type': 'petrol',
'id': '9c59a10e-8460-59a0-9acb-849afdfd2004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re93344',
'listing': 'auction',
'location': 'fr, loyettes',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 139415,
'odometer_in_km': 139415,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-01',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:16:24Z',
'fuel_type': 'petrol',
'id': '9c59a10e-8460-59a0-9acb-849afdfd2004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE93344',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '208',
'odometer': 139415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE93344%27 HTTP/1.1" 200 None
2025-12-05 17:12:19 [auto1.fr] INFO: Saving data for RE93344: {'auction_closing_time': 1765037784.0, 'created_time': 1764350108.560042, 'last_price_update_time': 1764954739.169743}
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RE93344') HTTP/1.1" 204 0
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_722d4ad55e79dfffeb9f929d5f97983c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ88026> (referer: https://www.auto1.com/v1/car-details-view/YJ88026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX17937> (referer: https://www.auto1.com/v1/car-details-view/TX17937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_f9fc81f3e3a2f6980717924c2ead5a61.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_058cd9576800c29ecdca7c7a456a39fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_a8b9b8f7a3a2a7a3aaca6f1db1bc4898.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG90809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd45d0>
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_722d4ad55e79dfffeb9f929d5f97983c.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_722d4ad55e79dfffeb9f929d5f97983c.jpg saved to cache
2025-12-05 17:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX29888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f7eb91f-018e-549a-ab88-ad900daab80f with identifier: YJ88026
2025-12-05 17:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f7eb91f-018e-549a-ab88-ad900daab80f with scrape type 2
2025-12-05 17:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f7eb91f-018e-549a-ab88-ad900daab80f with scrape type 2
2025-12-05 17:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3f7eb91f-018e-549a-ab88-ad900daab80f, identifier: YJ88026
2025-12-05 17:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77ee55f-f5a7-500d-aa5b-73d5626b78e4 with identifier: TX17937
2025-12-05 17:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77ee55f-f5a7-500d-aa5b-73d5626b78e4 with scrape type 2
2025-12-05 17:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e77ee55f-f5a7-500d-aa5b-73d5626b78e4 with scrape type 2
2025-12-05 17:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e77ee55f-f5a7-500d-aa5b-73d5626b78e4, identifier: TX17937
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f04550>
2025-12-05 17:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_f9fc81f3e3a2f6980717924c2ead5a61.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_f9fc81f3e3a2f6980717924c2ead5a61.jpg saved to cache
2025-12-05 17:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57e5e10>
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_058cd9576800c29ecdca7c7a456a39fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_058cd9576800c29ecdca7c7a456a39fa.jpg saved to cache
2025-12-05 17:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5741390>
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_a8b9b8f7a3a2a7a3aaca6f1db1bc4898.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_a8b9b8f7a3a2a7a3aaca6f1db1bc4898.jpg saved to cache
2025-12-05 17:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3f7eb91f-018e-549a-ab88-ad900daab80f with identifier: YJ88026
2025-12-05 17:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3f7eb91f-018e-549a-ab88-ad900daab80f with identifier: YJ88026
2025-12-05 17:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3f7eb91f-018e-549a-ab88-ad900daab80f with identifier: YJ88026 to the API
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ88026>
{'auction_title': '',
'c_o_2_emission_value': 206,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2025-12-06T16:51:22Z',
'fuel_type': 'petrol',
'id': '3f7eb91f-018e-549a-ab88-ad900daab80f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ88026',
'listing': 'auction',
'location': 'FR',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 95937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport P200 Mild-Hybrid AWD',
'transmission': 'automatic',
'trim': 'AWD',
'year': 2021}
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ88026%27 HTTP/1.1" 200 None
2025-12-05 17:12:20 [auto1.fr] INFO: Saving data for YJ88026: {'auction_closing_time': 1765039882.0, 'created_time': 1764828179.151842, 'last_price_update_time': 1764954740.926315}
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ88026') HTTP/1.1" 204 0
2025-12-05 17:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e77ee55f-f5a7-500d-aa5b-73d5626b78e4 with identifier: TX17937
2025-12-05 17:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e77ee55f-f5a7-500d-aa5b-73d5626b78e4 with identifier: TX17937
2025-12-05 17:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e77ee55f-f5a7-500d-aa5b-73d5626b78e4 with identifier: TX17937 to the API
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX17937>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 455,
'expiration_date': '2025-12-06T16:56:57Z',
'fuel_type': 'hybrid',
'id': 'e77ee55f-f5a7-500d-aa5b-73d5626b78e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX17937',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Volvo',
'model': 'XC60',
'odometer': 119436,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-10-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 T8 Recharge Plug-in Hybrid Ultimate Dark AWD',
'transmission': 'automatic',
'trim': 'Ultimate Dark AWD',
'year': 2023}
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX17937%27 HTTP/1.1" 200 None
2025-12-05 17:12:21 [auto1.fr] INFO: Saving data for TX17937: {'auction_closing_time': 1765040217.0, 'created_time': 1763546512.692051, 'last_price_update_time': 1764954741.246968}
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX17937') HTTP/1.1" 204 0
2025-12-05 17:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC70892> (referer: https://www.auto1.com/v1/car-details-view/BC70892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_fd6e5547e611a765a95265165faf95b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_679b6df136973825400648132ff372c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7c7bbcf6aeaa5d982c13a799e86e86a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_23dc4af772a2aa9bbf18cd66cfbd7a25.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_88f65c72746e24c3b5ad3292ba6a727d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b43f10-6359-5c48-abcf-11988b4a1110 with identifier: BC70892
2025-12-05 17:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b43f10-6359-5c48-abcf-11988b4a1110 with scrape type 2
2025-12-05 17:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4b43f10-6359-5c48-abcf-11988b4a1110 with scrape type 2
2025-12-05 17:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4b43f10-6359-5c48-abcf-11988b4a1110, identifier: BC70892
2025-12-05 17:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4b43f10-6359-5c48-abcf-11988b4a1110 with identifier: BC70892
2025-12-05 17:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4b43f10-6359-5c48-abcf-11988b4a1110 with identifier: BC70892
2025-12-05 17:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4b43f10-6359-5c48-abcf-11988b4a1110 with identifier: BC70892 to the API
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC70892>
{'auction_title': '',
'c_o_2_emission_value': 42,
'category': 'Taxi',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 245,
'expiration_date': '2025-12-06T16:19:08Z',
'fuel_type': 'hybrid',
'id': 'c4b43f10-6359-5c48-abcf-11988b4a1110',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC70892',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 28638,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2021}
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC70892%27 HTTP/1.1" 200 None
2025-12-05 17:12:21 [auto1.fr] INFO: Saving data for BC70892: {'auction_closing_time': 1765037948.0, 'created_time': 1763658283.253772, 'last_price_update_time': 1764954741.789593}
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC70892') HTTP/1.1" 204 0
2025-12-05 17:12:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd6a50>
2025-12-05 17:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_fd6e5547e611a765a95265165faf95b6.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_fd6e5547e611a765a95265165faf95b6.jpg saved to cache
2025-12-05 17:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5774b90>
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_679b6df136973825400648132ff372c9.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_679b6df136973825400648132ff372c9.jpg saved to cache
2025-12-05 17:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5777c50>
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_7c7bbcf6aeaa5d982c13a799e86e86a7.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7c7bbcf6aeaa5d982c13a799e86e86a7.jpg saved to cache
2025-12-05 17:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfff90>
2025-12-05 17:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_23dc4af772a2aa9bbf18cd66cfbd7a25.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_23dc4af772a2aa9bbf18cd66cfbd7a25.jpg saved to cache
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c91750>
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_88f65c72746e24c3b5ad3292ba6a727d.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_88f65c72746e24c3b5ad3292ba6a727d.jpg saved to cache
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC29401> (referer: https://www.auto1.com/v1/car-details-view/GC29401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC31591> (referer: https://www.auto1.com/v1/car-details-view/LC31591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_411558317da2b2a78a42b1f16d93e54a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 with identifier: GC29401
2025-12-05 17:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 with scrape type 1
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_94574c4af903d772291aef2a951fde5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_94574c4af903d772291aef2a951fde5f.jpg not downloaded yet
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_6564ace96235854819f746345f44c948.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6564ace96235854819f746345f44c948.jpg not downloaded yet
2025-12-05 17:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6beab930-d75f-51cc-93e1-391f56adf233 with identifier: LC31591
2025-12-05 17:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6beab930-d75f-51cc-93e1-391f56adf233 with scrape type 1
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_aabe669732876552e134fb8a2dc2a118.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aabe669732876552e134fb8a2dc2a118.jpg not downloaded yet
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_ecd0ed323e16b536ab3b6641f7961c03.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_ecd0ed323e16b536ab3b6641f7961c03.jpg not downloaded yet
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_9ff305f93a16d860eabda33f1bb46ba4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_9ff305f93a16d860eabda33f1bb46ba4.jpg not downloaded yet
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d00b50>
2025-12-05 17:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_411558317da2b2a78a42b1f16d93e54a.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_411558317da2b2a78a42b1f16d93e54a.jpg saved to cache
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_289153f702541ad7a493afc8f2e8f02b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_289153f702541ad7a493afc8f2e8f02b.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_4ac9d4be58279991b0aefc27db5c0909.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4ac9d4be58279991b0aefc27db5c0909.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_9fced03a801377af558d62044240979b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_9fced03a801377af558d62044240979b.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_e5ee1a08b7a9a7643bcfee9710181a41.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_e5ee1a08b7a9a7643bcfee9710181a41.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_3acc8fa0d05ee6b8a5d2b402897141bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_3acc8fa0d05ee6b8a5d2b402897141bb.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_86653e924624237f4c30a0eba6811ca4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_86653e924624237f4c30a0eba6811ca4.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_6e526b75860929281392402a6c88a7cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6e526b75860929281392402a6c88a7cc.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_df5bb8eba2f975e1e61474be832a7366.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_df5bb8eba2f975e1e61474be832a7366.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_cea7806f15000be676844a1b9de278bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_cea7806f15000be676844a1b9de278bb.jpg not downloaded yet
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX46142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_aa23758c7b973581e3076633841e415a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aa23758c7b973581e3076633841e415a.jpg not downloaded yet
2025-12-05 17:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_4ada0169874198235d2e23770de9286f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_4ada0169874198235d2e23770de9286f.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_85d90623a4413ef90dd275ec18ada27f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_85d90623a4413ef90dd275ec18ada27f.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_f7c51ca0e5a306d008926422c74aa847.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_f7c51ca0e5a306d008926422c74aa847.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_920ebf856d3a82ea0932fe5decf17262.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_920ebf856d3a82ea0932fe5decf17262.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_82cec1d64928b9bdf1a6f9dc8e5d062c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_82cec1d64928b9bdf1a6f9dc8e5d062c.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_c6e626f855e6506a44c1fa5be67770ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_c6e626f855e6506a44c1fa5be67770ec.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_20f163fd08321a95494d27a4a1955e1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_20f163fd08321a95494d27a4a1955e1e.jpg not downloaded yet
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_cea7806f15000be676844a1b9de278bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_170412a66902b0e091d35b8cd7e7370d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_170412a66902b0e091d35b8cd7e7370d.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_73a225e7686be806c874168fe6052f12.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_73a225e7686be806c874168fe6052f12.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_96c5caf5adce540f8a6f1505f29f0946.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_96c5caf5adce540f8a6f1505f29f0946.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_16ea81ce6a4c18ef17dba7a3f4605f00.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_16ea81ce6a4c18ef17dba7a3f4605f00.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_2aefd3438528246431e79d9d9e43f027.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_2aefd3438528246431e79d9d9e43f027.jpg not downloaded yet
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP41249> (referer: https://www.auto1.com/v1/car-details-view/YP41249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_c6e626f855e6506a44c1fa5be67770ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_aa1d06ba410d051e79389b5fdf4c0727.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_aa1d06ba410d051e79389b5fdf4c0727.jpg not downloaded yet
2025-12-05 17:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_26186a5f499e66e2f8401b5a6bd737b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_26186a5f499e66e2f8401b5a6bd737b3.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_2a3df7983cb83a5c977677efcd255255.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_2a3df7983cb83a5c977677efcd255255.jpg not downloaded yet
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_4f97d15cdaf2f485338376797f8bd9aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4f97d15cdaf2f485338376797f8bd9aa.jpg not downloaded yet
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d36050>
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_cea7806f15000be676844a1b9de278bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_cea7806f15000be676844a1b9de278bb.jpg saved to cache
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_b02cf2e90070a022bbf92572757d0e1f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7cca09762e115877cc521247f37f59c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_16ea81ce6a4c18ef17dba7a3f4605f00.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_96c5caf5adce540f8a6f1505f29f0946.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_70ab3f36b1904a689be1f0ee3099ff2a.png%27 HTTP/1.1" 200 None
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_70ab3f36b1904a689be1f0ee3099ff2a.png not downloaded yet
2025-12-05 17:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9562d480-26d8-5689-b9ab-605e1c1345c7 with identifier: YP41249
2025-12-05 17:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9562d480-26d8-5689-b9ab-605e1c1345c7 with scrape type 2
2025-12-05 17:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9562d480-26d8-5689-b9ab-605e1c1345c7 with scrape type 2
2025-12-05 17:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9562d480-26d8-5689-b9ab-605e1c1345c7, identifier: YP41249
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1f6d0>
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_c6e626f855e6506a44c1fa5be67770ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_c6e626f855e6506a44c1fa5be67770ec.jpg saved to cache
2025-12-05 17:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9562d480-26d8-5689-b9ab-605e1c1345c7 with identifier: YP41249
2025-12-05 17:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9562d480-26d8-5689-b9ab-605e1c1345c7 with identifier: YP41249
2025-12-05 17:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 116762, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp41249', 'expiration_date': '2025-12-06t16:29:40z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '9562d480-26d8-5689-b9ab-605e1c1345c7', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 116762}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:29:40z',
'fuel_type': 'petrol',
'id': '9562d480-26d8-5689-b9ab-605e1c1345c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp41249',
'listing': 'auction',
'location': 'fr, allennes-les-marais',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 116762,
'odometer_in_km': 116762,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2016}
2025-12-05 17:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 9562d480-26d8-5689-b9ab-605e1c1345c7 spider: auto1.fr
2025-12-05 17:12:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9562d480-26d8-5689-b9ab-605e1c1345c7 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 116762, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp41249', 'expiration_date': '2025-12-06t16:29:40z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '9562d480-26d8-5689-b9ab-605e1c1345c7', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 116762}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 82,
'expiration_date': '2025-12-06t16:29:40z',
'fuel_type': 'petrol',
'id': '9562d480-26d8-5689-b9ab-605e1c1345c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp41249',
'listing': 'auction',
'location': 'fr, allennes-les-marais',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 116762,
'odometer_in_km': 116762,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 vti style',
'transmission': 'manual',
'trim': 'style',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2025-12-06T16:29:40Z',
'fuel_type': 'petrol',
'id': '9562d480-26d8-5689-b9ab-605e1c1345c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP41249',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '208',
'odometer': 116762,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP41249%27 HTTP/1.1" 200 None
2025-12-05 17:12:25 [auto1.fr] INFO: Saving data for YP41249: {'auction_closing_time': 1765038580.0, 'created_time': 1763658068.217265, 'last_price_update_time': 1764954745.451518}
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP41249') HTTP/1.1" 204 0
2025-12-05 17:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_db5517d39d631de393fe98e117cf6988.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_97a4e1132126138db64829ad352aaf5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e52f10>
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_b02cf2e90070a022bbf92572757d0e1f.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_b02cf2e90070a022bbf92572757d0e1f.jpg saved to cache
2025-12-05 17:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e75f10>
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_7cca09762e115877cc521247f37f59c4.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7cca09762e115877cc521247f37f59c4.jpg saved to cache
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e66590>
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_16ea81ce6a4c18ef17dba7a3f4605f00.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_16ea81ce6a4c18ef17dba7a3f4605f00.jpg saved to cache
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582ae50>
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_96c5caf5adce540f8a6f1505f29f0946.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_96c5caf5adce540f8a6f1505f29f0946.jpg saved to cache
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_13ed309c02af3be21744a42180ea6925.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5904c10>
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_db5517d39d631de393fe98e117cf6988.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_db5517d39d631de393fe98e117cf6988.jpg saved to cache
2025-12-05 17:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb2550>
2025-12-05 17:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_97a4e1132126138db64829ad352aaf5c.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_97a4e1132126138db64829ad352aaf5c.jpg saved to cache
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_d13dcc7bf1845468fdae74cbaadd0c23.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cabf50>
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_13ed309c02af3be21744a42180ea6925.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_13ed309c02af3be21744a42180ea6925.jpg saved to cache
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b31d10>
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc5%252F56c5ce4b38b299b673d10e9814c2f8c2%252Fpa%252FJB21305_d13dcc7bf1845468fdae74cbaadd0c23.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_d13dcc7bf1845468fdae74cbaadd0c23.jpg saved to cache
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c78480f8-4de2-5255-a62f-a5c88acb7fe1
2025-12-05 17:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c78480f8-4de2-5255-a62f-a5c88acb7fe1, skipping ID generation
2025-12-05 17:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c78480f8-4de2-5255-a62f-a5c88acb7fe1 with scrape type 1
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c78480f8-4de2-5255-a62f-a5c88acb7fe1 from tracking dictionaries
2025-12-05 17:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c78480f8-4de2-5255-a62f-a5c88acb7fe1 sending to next pipeline
2025-12-05 17:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c78480f8-4de2-5255-a62f-a5c88acb7fe1, identifier: JB21305
2025-12-05 17:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c78480f8-4de2-5255-a62f-a5c88acb7fe1 with identifier: JB21305
2025-12-05 17:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c78480f8-4de2-5255-a62f-a5c88acb7fe1 with identifier: JB21305
2025-12-05 17:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169707 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169707
2025-12-05 17:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c78480f8-4de2-5255-a62f-a5c88acb7fe1 spider: auto1.fr
2025-12-05 17:12:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c78480f8-4de2-5255-a62f-a5c88acb7fe1 due to rule: high_mileage_for_country.json, error: 169707 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
169707
{'auction_title': '',
'c_o_2_emission_value': 87,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2025-12-06T16:26:54Z',
'fuel_type': 'hybrid',
'id': 'c78480f8-4de2-5255-a62f-a5c88acb7fe1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB21305',
'listing': 'auction',
'location': 'FR, Mulhouse',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 169707,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2750113,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_d13dcc7bf1845468fdae74cbaadd0c23.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2718566,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_13ed309c02af3be21744a42180ea6925.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503783,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7cca09762e115877cc521247f37f59c4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2436832,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_b02cf2e90070a022bbf92572757d0e1f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2743205,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_97a4e1132126138db64829ad352aaf5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2528579,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_db5517d39d631de393fe98e117cf6988.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_411558317da2b2a78a42b1f16d93e54a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_88f65c72746e24c3b5ad3292ba6a727d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2717103,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_23dc4af772a2aa9bbf18cd66cfbd7a25.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2628478,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_fd6e5547e611a765a95265165faf95b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2623259,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_679b6df136973825400648132ff372c9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2760402,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_7c7bbcf6aeaa5d982c13a799e86e86a7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_058cd9576800c29ecdca7c7a456a39fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_f9fc81f3e3a2f6980717924c2ead5a61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_a8b9b8f7a3a2a7a3aaca6f1db1bc4898.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c78480f8-4de2-5255-a62f-a5c88acb7fe1/c78480f8-4de2-5255-a62f-a5c88acb7fe1_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/c5/56c5ce4b38b299b673d10e9814c2f8c2/pa/JB21305_722d4ad55e79dfffeb9f929d5f97983c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Graphic',
'transmission': 'automatic',
'trim': 'Graphic',
'year': 2018}
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB21305%27 HTTP/1.1" 200 None
2025-12-05 17:12:28 [auto1.fr] INFO: Saving data for JB21305: {'created_time': 1764954748.110608, 'last_price_update_time': 1764954748.110644, 'auction_closing_time': 1765038414.0}
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB21305') HTTP/1.1" 204 0
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_2aefd3438528246431e79d9d9e43f027.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_26186a5f499e66e2f8401b5a6bd737b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_2a3df7983cb83a5c977677efcd255255.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_aa1d06ba410d051e79389b5fdf4c0727.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_70ab3f36b1904a689be1f0ee3099ff2a.png> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4f97d15cdaf2f485338376797f8bd9aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_73a225e7686be806c874168fe6052f12.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX29888> (referer: https://www.auto1.com/v1/car-details-view/ZX29888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_82cec1d64928b9bdf1a6f9dc8e5d062c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_920ebf856d3a82ea0932fe5decf17262.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_df5bb8eba2f975e1e61474be832a7366.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6e526b75860929281392402a6c88a7cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f1790>
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_2aefd3438528246431e79d9d9e43f027.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_2aefd3438528246431e79d9d9e43f027.jpg saved to cache
2025-12-05 17:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57f1cd0>
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_26186a5f499e66e2f8401b5a6bd737b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_26186a5f499e66e2f8401b5a6bd737b3.jpg saved to cache
2025-12-05 17:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_86653e924624237f4c30a0eba6811ca4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b0f790>
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_2a3df7983cb83a5c977677efcd255255.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_2a3df7983cb83a5c977677efcd255255.jpg saved to cache
2025-12-05 17:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_3acc8fa0d05ee6b8a5d2b402897141bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59ad550>
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_aa1d06ba410d051e79389b5fdf4c0727.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_aa1d06ba410d051e79389b5fdf4c0727.jpg saved to cache
2025-12-05 17:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:12:29 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:12:29 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:12:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3e210>
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_15.png HTTP/1.1" 201 0
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_70ab3f36b1904a689be1f0ee3099ff2a.png') HTTP/1.1" 204 0
2025-12-05 17:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_70ab3f36b1904a689be1f0ee3099ff2a.png saved to cache
2025-12-05 17:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e9d8d0>
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_4f97d15cdaf2f485338376797f8bd9aa.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4f97d15cdaf2f485338376797f8bd9aa.jpg saved to cache
2025-12-05 17:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a94dd0>
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_73a225e7686be806c874168fe6052f12.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_73a225e7686be806c874168fe6052f12.jpg saved to cache
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db62b88f-b379-595e-a248-3b01d6b301e0 with identifier: ZX29888
2025-12-05 17:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db62b88f-b379-595e-a248-3b01d6b301e0 with scrape type 1
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_c1f19e2ec647cac423686e1cd2223fc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c1f19e2ec647cac423686e1cd2223fc6.jpg not downloaded yet
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578c610>
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_82cec1d64928b9bdf1a6f9dc8e5d062c.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_82cec1d64928b9bdf1a6f9dc8e5d062c.jpg saved to cache
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c67750>
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_920ebf856d3a82ea0932fe5decf17262.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_920ebf856d3a82ea0932fe5decf17262.jpg saved to cache
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5976990>
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_df5bb8eba2f975e1e61474be832a7366.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_df5bb8eba2f975e1e61474be832a7366.jpg saved to cache
2025-12-05 17:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7ef10>
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_6e526b75860929281392402a6c88a7cc.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6e526b75860929281392402a6c88a7cc.jpg saved to cache
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a7cf50>
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_86653e924624237f4c30a0eba6811ca4.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_86653e924624237f4c30a0eba6811ca4.jpg saved to cache
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_e5ee1a08b7a9a7643bcfee9710181a41.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_2c4a3cdbe85f97b87e6c8ea331887da1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2c4a3cdbe85f97b87e6c8ea331887da1.jpg not downloaded yet
2025-12-05 17:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD64231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG90809> (referer: https://www.auto1.com/v1/car-details-view/WG90809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5893850>
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_3acc8fa0d05ee6b8a5d2b402897141bb.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_3acc8fa0d05ee6b8a5d2b402897141bb.jpg saved to cache
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_9fced03a801377af558d62044240979b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_80e38fc49f49292f1fed489e5d618ed1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_80e38fc49f49292f1fed489e5d618ed1.jpg not downloaded yet
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_2e740434c65dd7e7427d78945b9bb472.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2e740434c65dd7e7427d78945b9bb472.jpg not downloaded yet
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d14110>
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_e5ee1a08b7a9a7643bcfee9710181a41.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_e5ee1a08b7a9a7643bcfee9710181a41.jpg saved to cache
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 with identifier: WG90809
2025-12-05 17:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 with scrape type 2
2025-12-05 17:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 with scrape type 2
2025-12-05 17:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6, identifier: WG90809
2025-12-05 17:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 with identifier: WG90809
2025-12-05 17:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 with identifier: WG90809
2025-12-05 17:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183814 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
183814
2025-12-05 17:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 spider: auto1.fr
2025-12-05 17:12:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6 due to rule: high_mileage_for_country.json, error: 183814 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
183814
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2025-12-06T16:20:14Z',
'fuel_type': 'diesel',
'id': '5d72f7dd-b61d-52f3-a1a1-b15b1b8467c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG90809',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': '2er',
'odometer': 183814,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2er 216d Active Tourer M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG90809%27 HTTP/1.1" 200 None
2025-12-05 17:12:32 [auto1.fr] INFO: Saving data for WG90809: {'auction_closing_time': 1765038014.0, 'created_time': 1762794791.612023, 'last_price_update_time': 1764954752.343917}
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG90809') HTTP/1.1" 204 0
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2c4a3cdbe85f97b87e6c8ea331887da1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_536448882aa007f9dad8fe97ba56098c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_536448882aa007f9dad8fe97ba56098c.jpg not downloaded yet
2025-12-05 17:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c1f19e2ec647cac423686e1cd2223fc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_c91f2de7cbdb778f1c64647331ed4030.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c91f2de7cbdb778f1c64647331ed4030.jpg not downloaded yet
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX46142> (referer: https://www.auto1.com/v1/car-details-view/ZX46142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR74460> (referer: https://www.auto1.com/v1/car-details-view/CR74460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5841710>
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_9fced03a801377af558d62044240979b.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_9fced03a801377af558d62044240979b.jpg saved to cache
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_fd8b2fe7a8982dbccbf8979009a642a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd8b2fe7a8982dbccbf8979009a642a0.jpg not downloaded yet
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_289153f702541ad7a493afc8f2e8f02b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4ac9d4be58279991b0aefc27db5c0909.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_44424ca0c3d51ca64b1044e34301fe2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_44424ca0c3d51ca64b1044e34301fe2a.jpg not downloaded yet
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC37303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW87176> (referer: https://www.auto1.com/v1/car-details-view/FW87176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de0790>
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_2c4a3cdbe85f97b87e6c8ea331887da1.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2c4a3cdbe85f97b87e6c8ea331887da1.jpg saved to cache
2025-12-05 17:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4de3a50>
2025-12-05 17:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_c1f19e2ec647cac423686e1cd2223fc6.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c1f19e2ec647cac423686e1cd2223fc6.jpg saved to cache
2025-12-05 17:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df3355b2-a99f-5cc7-847d-8ef2670a63ca with identifier: ZX46142
2025-12-05 17:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df3355b2-a99f-5cc7-847d-8ef2670a63ca with scrape type 2
2025-12-05 17:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df3355b2-a99f-5cc7-847d-8ef2670a63ca with scrape type 2
2025-12-05 17:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df3355b2-a99f-5cc7-847d-8ef2670a63ca, identifier: ZX46142
2025-12-05 17:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be with identifier: CR74460
2025-12-05 17:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be with scrape type 2
2025-12-05 17:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be with scrape type 2
2025-12-05 17:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be, identifier: CR74460
2025-12-05 17:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX01417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df3355b2-a99f-5cc7-847d-8ef2670a63ca with identifier: ZX46142
2025-12-05 17:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df3355b2-a99f-5cc7-847d-8ef2670a63ca with identifier: ZX46142
2025-12-05 17:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158762 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158762
2025-12-05 17:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: df3355b2-a99f-5cc7-847d-8ef2670a63ca spider: auto1.fr
2025-12-05 17:12:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: df3355b2-a99f-5cc7-847d-8ef2670a63ca due to rule: high_mileage_for_country.json, error: 158762 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158762
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:08:25Z',
'fuel_type': 'diesel',
'id': 'df3355b2-a99f-5cc7-847d-8ef2670a63ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX46142',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '3008',
'odometer': 158762,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Crossway',
'transmission': 'automatic',
'trim': 'Crossway',
'year': 2017}
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX46142%27 HTTP/1.1" 200 None
2025-12-05 17:12:33 [auto1.fr] INFO: Saving data for ZX46142: {'auction_closing_time': 1765037305.0, 'created_time': 1764263055.179342, 'last_price_update_time': 1764954753.608346}
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZX46142') HTTP/1.1" 204 0
2025-12-05 17:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be with identifier: CR74460
2025-12-05 17:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be with identifier: CR74460
2025-12-05 17:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2025-12-05 17:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be spider: auto1.fr
2025-12-05 17:12:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7a8f6faf-8ec5-5f8d-bb4f-038af2a284be due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:59:17Z',
'fuel_type': 'diesel',
'id': '7a8f6faf-8ec5-5f8d-bb4f-038af2a284be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR74460',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 123653,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-10',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Club L1',
'transmission': 'manual',
'trim': 'Club L1',
'year': 2018}
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR74460%27 HTTP/1.1" 200 None
2025-12-05 17:12:33 [auto1.fr] INFO: Saving data for CR74460: {'auction_closing_time': 1765040357.0, 'created_time': 1764669848.912168, 'last_price_update_time': 1764954753.829348}
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CR74460') HTTP/1.1" 204 0
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_0900814d6023628fc77c00925c12ffcb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_0900814d6023628fc77c00925c12ffcb.jpg not downloaded yet
2025-12-05 17:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_20f163fd08321a95494d27a4a1955e1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2e740434c65dd7e7427d78945b9bb472.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_536448882aa007f9dad8fe97ba56098c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG60875> (referer: https://www.auto1.com/v1/car-details-view/UG60875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_e4389762245c50b8c4fdd0a17b6ae353.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_e4389762245c50b8c4fdd0a17b6ae353.jpg not downloaded yet
2025-12-05 17:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_f7c51ca0e5a306d008926422c74aa847.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579f290>
2025-12-05 17:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_289153f702541ad7a493afc8f2e8f02b.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_289153f702541ad7a493afc8f2e8f02b.jpg saved to cache
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a64b90>
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_4ac9d4be58279991b0aefc27db5c0909.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4ac9d4be58279991b0aefc27db5c0909.jpg saved to cache
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a52830-d0ba-5a65-a31e-38d11043b3c6 with identifier: FW87176
2025-12-05 17:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a52830-d0ba-5a65-a31e-38d11043b3c6 with scrape type 2
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67a52830-d0ba-5a65-a31e-38d11043b3c6 with scrape type 2
2025-12-05 17:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 67a52830-d0ba-5a65-a31e-38d11043b3c6, identifier: FW87176
2025-12-05 17:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd8b2fe7a8982dbccbf8979009a642a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_b5be0627a26f1cf209b1f6834f5b3368.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_b5be0627a26f1cf209b1f6834f5b3368.jpg not downloaded yet
2025-12-05 17:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 67a52830-d0ba-5a65-a31e-38d11043b3c6 with identifier: FW87176
2025-12-05 17:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 67a52830-d0ba-5a65-a31e-38d11043b3c6 with identifier: FW87176
2025-12-05 17:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 41043, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw87176', 'expiration_date': '2025-12-06t16:45:26z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '67a52830-d0ba-5a65-a31e-38d11043b3c6', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 41043}
Failed validating None in schema:
False
On instance:
{'age_in_months': 60,
'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 75,
'expiration_date': '2025-12-06t16:45:26z',
'fuel_type': 'petrol',
'id': '67a52830-d0ba-5a65-a31e-38d11043b3c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw87176',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 41043,
'odometer_in_km': 41043,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 edition',
'transmission': 'manual',
'trim': 'edition',
'year': 2020}
2025-12-05 17:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 67a52830-d0ba-5a65-a31e-38d11043b3c6 spider: auto1.fr
2025-12-05 17:12:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 67a52830-d0ba-5a65-a31e-38d11043b3c6 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 41043, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw87176', 'expiration_date': '2025-12-06t16:45:26z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '67a52830-d0ba-5a65-a31e-38d11043b3c6', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 41043}
Failed validating None in schema:
False
On instance:
{'age_in_months': 60,
'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'red',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 75,
'expiration_date': '2025-12-06t16:45:26z',
'fuel_type': 'petrol',
'id': '67a52830-d0ba-5a65-a31e-38d11043b3c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw87176',
'listing': 'auction',
'location': 'fr, le havre',
'make': 'opel',
'make_model': 'opel corsa',
'model': 'corsa',
'odometer': 41043,
'odometer_in_km': 41043,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-29',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel corsa 1.2 edition',
'transmission': 'manual',
'trim': 'edition',
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2025-12-06T16:45:26Z',
'fuel_type': 'petrol',
'id': '67a52830-d0ba-5a65-a31e-38d11043b3c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW87176',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'Opel',
'model': 'Corsa',
'odometer': 41043,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2020}
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW87176%27 HTTP/1.1" 200 None
2025-12-05 17:12:34 [auto1.fr] INFO: Saving data for FW87176: {'auction_closing_time': 1765039526.0, 'created_time': 1764263195.016723, 'last_price_update_time': 1764954754.87362}
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW87176') HTTP/1.1" 204 0
2025-12-05 17:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c91f2de7cbdb778f1c64647331ed4030.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_4fc53059502288161e1c245c9e9cac77.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_4fc53059502288161e1c245c9e9cac77.jpg not downloaded yet
2025-12-05 17:12:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7b3a310>
2025-12-05 17:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_20f163fd08321a95494d27a4a1955e1e.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_20f163fd08321a95494d27a4a1955e1e.jpg saved to cache
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58bef10>
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_2e740434c65dd7e7427d78945b9bb472.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2e740434c65dd7e7427d78945b9bb472.jpg saved to cache
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58bc550>
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_536448882aa007f9dad8fe97ba56098c.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_536448882aa007f9dad8fe97ba56098c.jpg saved to cache
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580dc2c6-228b-58ad-91e6-3b7ed6db8fce with identifier: UG60875
2025-12-05 17:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580dc2c6-228b-58ad-91e6-3b7ed6db8fce with scrape type 1
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 580dc2c6-228b-58ad-91e6-3b7ed6db8fce
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_76712b9751090b863be5690f465c88fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_76712b9751090b863be5690f465c88fa.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_14996efa485f5c20d7398a0d65f9b168.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_14996efa485f5c20d7398a0d65f9b168.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_44f6919bcc5de2d1503f5ba602a994f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_44f6919bcc5de2d1503f5ba602a994f6.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_a49b998f4b2da5abc303a78ccdc95326.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_a49b998f4b2da5abc303a78ccdc95326.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_708e223c2bfc8cadcb5a1bf9fbacca43.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_708e223c2bfc8cadcb5a1bf9fbacca43.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_393dbc7d7460b95b78700036a02534f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_393dbc7d7460b95b78700036a02534f4.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_2782580c841880de9abaeec9fd87306e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_2782580c841880de9abaeec9fd87306e.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_c79194dafc3c0eef0c7666c3b2f4ae08.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_c79194dafc3c0eef0c7666c3b2f4ae08.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_3eb7bc9736d1bb3e80e3903ddf347f3e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_3eb7bc9736d1bb3e80e3903ddf347f3e.jpg already downloaded
2025-12-05 17:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_46299d625a19b5d16d7b65b410b7a25f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_46299d625a19b5d16d7b65b410b7a25f.jpg already downloaded
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_4a2e0fe3e511d980093d1847df9b1393.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_4a2e0fe3e511d980093d1847df9b1393.jpg already downloaded
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_137391a889c1eee27bfd5bf794125fda.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_137391a889c1eee27bfd5bf794125fda.jpg already downloaded
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_e688af912f19b025613e82e3fb919f2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_e688af912f19b025613e82e3fb919f2a.jpg already downloaded
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_f0792f567b62094f5db870ce9c074306.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_f0792f567b62094f5db870ce9c074306.jpg already downloaded
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_360d3f470ce0c80bbccd65909f8103b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_360d3f470ce0c80bbccd65909f8103b2.jpg already downloaded
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F7f%252F317f7fff1d4245a3dbfec0473663f7de%252Fpa%252FUG60875_5e1cac97dd0ffe9a44cdb1101bda91db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_5e1cac97dd0ffe9a44cdb1101bda91db.jpg already downloaded
2025-12-05 17:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 580dc2c6-228b-58ad-91e6-3b7ed6db8fce, identifier: UG60875
2025-12-05 17:12:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c4e790>
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_f7c51ca0e5a306d008926422c74aa847.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_f7c51ca0e5a306d008926422c74aa847.jpg saved to cache
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 580dc2c6-228b-58ad-91e6-3b7ed6db8fce with identifier: UG60875
2025-12-05 17:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 580dc2c6-228b-58ad-91e6-3b7ed6db8fce with identifier: UG60875
2025-12-05 17:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 580dc2c6-228b-58ad-91e6-3b7ed6db8fce with identifier: UG60875 to the API
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG60875>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:05:42Z',
'fuel_type': 'diesel',
'id': '580dc2c6-228b-58ad-91e6-3b7ed6db8fce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG60875',
'listing': 'auction',
'location': 'FR, La Garde',
'make': 'Renault',
'model': 'Megane',
'odometer': 93238,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_76712b9751090b863be5690f465c88fa.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_14996efa485f5c20d7398a0d65f9b168.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_44f6919bcc5de2d1503f5ba602a994f6.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_a49b998f4b2da5abc303a78ccdc95326.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_708e223c2bfc8cadcb5a1bf9fbacca43.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_393dbc7d7460b95b78700036a02534f4.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_2782580c841880de9abaeec9fd87306e.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_c79194dafc3c0eef0c7666c3b2f4ae08.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_3eb7bc9736d1bb3e80e3903ddf347f3e.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_46299d625a19b5d16d7b65b410b7a25f.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_4a2e0fe3e511d980093d1847df9b1393.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_137391a889c1eee27bfd5bf794125fda.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_e688af912f19b025613e82e3fb919f2a.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_f0792f567b62094f5db870ce9c074306.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_360d3f470ce0c80bbccd65909f8103b2.jpg',
'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_5e1cac97dd0ffe9a44cdb1101bda91db.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_76712b9751090b863be5690f465c88fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_14996efa485f5c20d7398a0d65f9b168.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_44f6919bcc5de2d1503f5ba602a994f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_a49b998f4b2da5abc303a78ccdc95326.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_708e223c2bfc8cadcb5a1bf9fbacca43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_393dbc7d7460b95b78700036a02534f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_2782580c841880de9abaeec9fd87306e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_c79194dafc3c0eef0c7666c3b2f4ae08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_3eb7bc9736d1bb3e80e3903ddf347f3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_46299d625a19b5d16d7b65b410b7a25f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_4a2e0fe3e511d980093d1847df9b1393.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_137391a889c1eee27bfd5bf794125fda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_e688af912f19b025613e82e3fb919f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_f0792f567b62094f5db870ce9c074306.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_360d3f470ce0c80bbccd65909f8103b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_314961ba-1beb-5269-b72a-796ffeea0068/314961ba-1beb-5269-b72a-796ffeea0068_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/7f/317f7fff1d4245a3dbfec0473663f7de/pa/UG60875_5e1cac97dd0ffe9a44cdb1101bda91db.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2021}
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG60875%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [auto1.fr] INFO: Saving data for UG60875: {'created_time': 1764954756.918589, 'last_price_update_time': 1764954756.9186, 'auction_closing_time': 1765037142.0}
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG60875') HTTP/1.1" 204 0
2025-12-05 17:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_9ff305f93a16d860eabda33f1bb46ba4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_1b23c69c7909684a23d62109cb0249de.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1b23c69c7909684a23d62109cb0249de.jpg not downloaded yet
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5882050>
2025-12-05 17:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_fd8b2fe7a8982dbccbf8979009a642a0.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd8b2fe7a8982dbccbf8979009a642a0.jpg saved to cache
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_4ada0169874198235d2e23770de9286f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD64231> (referer: https://www.auto1.com/v1/car-details-view/UD64231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_ecd0ed323e16b536ab3b6641f7961c03.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_1e80063a2c252aa17c09e750d55a67c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1e80063a2c252aa17c09e750d55a67c3.jpg not downloaded yet
2025-12-05 17:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d22f10>
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_c91f2de7cbdb778f1c64647331ed4030.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c91f2de7cbdb778f1c64647331ed4030.jpg saved to cache
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5827310>
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_9ff305f93a16d860eabda33f1bb46ba4.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_9ff305f93a16d860eabda33f1bb46ba4.jpg saved to cache
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_fd70901dad3fe0f586300b795ef2c136.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd70901dad3fe0f586300b795ef2c136.jpg not downloaded yet
2025-12-05 17:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aabe669732876552e134fb8a2dc2a118.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_7076d3a084eddfa5fea2d5a99d35c2d2.png%27 HTTP/1.1" 200 None
2025-12-05 17:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_7076d3a084eddfa5fea2d5a99d35c2d2.png not downloaded yet
2025-12-05 17:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d65dd0>
2025-12-05 17:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_4ada0169874198235d2e23770de9286f.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_4ada0169874198235d2e23770de9286f.jpg saved to cache
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867d1242-9baf-54bd-b8a7-709c233c123c with identifier: UD64231
2025-12-05 17:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867d1242-9baf-54bd-b8a7-709c233c123c with scrape type 1
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 867d1242-9baf-54bd-b8a7-709c233c123c
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_94b271046cb86316b213269ec69d8e36.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_1fd7b3dc280d117e90bc1d6041476809.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_a003c8709e06a8af7d0fec6455240553.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_ccbccd9d8763169c840d3fc9638c471a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg already downloaded
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F31%252F263113178625544059c6a46dc598c819%252Fpa%252FUD64231_5493372ddc6fe1f06dc949e460d181bf.png%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png already downloaded
2025-12-05 17:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 867d1242-9baf-54bd-b8a7-709c233c123c, identifier: UD64231
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf3210>
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_ecd0ed323e16b536ab3b6641f7961c03.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_ecd0ed323e16b536ab3b6641f7961c03.jpg saved to cache
2025-12-05 17:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 867d1242-9baf-54bd-b8a7-709c233c123c with identifier: UD64231
2025-12-05 17:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 867d1242-9baf-54bd-b8a7-709c233c123c with identifier: UD64231
2025-12-05 17:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 e-thp féline', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 118190, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud64231', 'expiration_date': '2025-12-06t16:54:03z', 'origin_country_code': 'fr', 'trim': 'féline', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '867d1242-9baf-54bd-b8a7-709c233c123c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59869}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2638534}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59700}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2648471}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73907}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2629507}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61041}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80456}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 42293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62107}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 94072}], 'current_year_diff': 7, 'age_in_months': 93, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 118190}
Failed validating None in schema:
False
On instance:
{'age_in_months': 93,
'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:54:03z',
'fuel_type': 'petrol',
'id': '867d1242-9baf-54bd-b8a7-709c233c123c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud64231',
'listing': 'auction',
'location': 'fr, chartres de bretagne',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 118190,
'odometer_in_km': 118190,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2638534,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648471,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2629507,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 94072,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-11',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 e-thp féline',
'transmission': 'manual',
'trim': 'féline',
'year': 2018}
2025-12-05 17:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 867d1242-9baf-54bd-b8a7-709c233c123c spider: auto1.fr
2025-12-05 17:12:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 867d1242-9baf-54bd-b8a7-709c233c123c due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 e-thp féline', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 118190, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud64231', 'expiration_date': '2025-12-06t16:54:03z', 'origin_country_code': 'fr', 'trim': 'féline', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg', 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '867d1242-9baf-54bd-b8a7-709c233c123c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59869}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2638534}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59700}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2648471}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73907}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2629507}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61041}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80456}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 42293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62107}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 94072}], 'current_year_diff': 7, 'age_in_months': 93, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 118190}
Failed validating None in schema:
False
On instance:
{'age_in_months': 93,
'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:54:03z',
'fuel_type': 'petrol',
'id': '867d1242-9baf-54bd-b8a7-709c233c123c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud64231',
'listing': 'auction',
'location': 'fr, chartres de bretagne',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 118190,
'odometer_in_km': 118190,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2638534,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648471,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2629507,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 94072,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-11',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 1.2 e-thp féline',
'transmission': 'manual',
'trim': 'féline',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:54:03Z',
'fuel_type': 'petrol',
'id': '867d1242-9baf-54bd-b8a7-709c233c123c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD64231',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '208',
'odometer': 118190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg',
'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_94b271046cb86316b213269ec69d8e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_e6ea3e1c7c658ffee8842cadeff682ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_492cfa25fc2c8e9843a754a60a5813fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2638534,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_6933d6f0c4963c43bb912c8a9413f5a2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_1fd7b3dc280d117e90bc1d6041476809.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_b1eb7cc0c041452cd5a41d8e83bf5e4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3a2904c8e2d10f219d337e5d67e203cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648471,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_8cd7c815406cd51b0ad8e8bbf2f1256d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a003c8709e06a8af7d0fec6455240553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_a2e8fbbcd11f81b2531c4f27b78a2142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2629507,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_3c42b949d9f6a2b2f6ab1c9afbf8bb4e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_9c4c7ef799f9b49b7431e253201c1e89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_c99c4b9c7f04ba1deb9bd7262a11dfc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_ccbccd9d8763169c840d3fc9638c471a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_de2ed8c591357d8d942f53c9fa3ad95d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_867d1242-9baf-54bd-b8a7-709c233c123c/867d1242-9baf-54bd-b8a7-709c233c123c_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 94072,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img26/31/263113178625544059c6a46dc598c819/pa/UD64231_5493372ddc6fe1f06dc949e460d181bf.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Féline',
'transmission': 'manual',
'trim': 'Féline',
'year': 2018}
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD64231%27 HTTP/1.1" 200 None
2025-12-05 17:12:38 [auto1.fr] INFO: Saving data for UD64231: {'created_time': 1764954758.96541, 'last_price_update_time': 1764954758.965421, 'auction_closing_time': 1765040043.0}
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UD64231') HTTP/1.1" 204 0
2025-12-05 17:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_85d90623a4413ef90dd275ec18ada27f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_94574c4af903d772291aef2a951fde5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_170412a66902b0e091d35b8cd7e7370d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_4fc53059502288161e1c245c9e9cac77.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ded650>
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_aabe669732876552e134fb8a2dc2a118.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aabe669732876552e134fb8a2dc2a118.jpg saved to cache
2025-12-05 17:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aa23758c7b973581e3076633841e415a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_e4389762245c50b8c4fdd0a17b6ae353.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ce510>
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_85d90623a4413ef90dd275ec18ada27f.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_85d90623a4413ef90dd275ec18ada27f.jpg saved to cache
2025-12-05 17:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d64d10>
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_94574c4af903d772291aef2a951fde5f.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_94574c4af903d772291aef2a951fde5f.jpg saved to cache
2025-12-05 17:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb4b50>
2025-12-05 17:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_170412a66902b0e091d35b8cd7e7370d.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_170412a66902b0e091d35b8cd7e7370d.jpg saved to cache
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5875810>
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_4fc53059502288161e1c245c9e9cac77.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_4fc53059502288161e1c245c9e9cac77.jpg saved to cache
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1b23c69c7909684a23d62109cb0249de.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd70901dad3fe0f586300b795ef2c136.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_7076d3a084eddfa5fea2d5a99d35c2d2.png> (referer: https://www.auto1.com/)
2025-12-05 17:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC37303> (referer: https://www.auto1.com/v1/car-details-view/NC37303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX01417> (referer: https://www.auto1.com/v1/car-details-view/RX01417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT91443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5877b50>
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F26%252Ff0268044894a74b9339d30cd6407a482%252Fpa%252FLC31591_aa23758c7b973581e3076633841e415a.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aa23758c7b973581e3076633841e415a.jpg saved to cache
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6beab930-d75f-51cc-93e1-391f56adf233
2025-12-05 17:12:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6beab930-d75f-51cc-93e1-391f56adf233, skipping ID generation
2025-12-05 17:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6beab930-d75f-51cc-93e1-391f56adf233 with scrape type 1
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6beab930-d75f-51cc-93e1-391f56adf233 from tracking dictionaries
2025-12-05 17:12:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6beab930-d75f-51cc-93e1-391f56adf233 sending to next pipeline
2025-12-05 17:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6beab930-d75f-51cc-93e1-391f56adf233, identifier: LC31591
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58b14d0>
2025-12-05 17:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_e4389762245c50b8c4fdd0a17b6ae353.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_e4389762245c50b8c4fdd0a17b6ae353.jpg saved to cache
2025-12-05 17:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6beab930-d75f-51cc-93e1-391f56adf233 with identifier: LC31591
2025-12-05 17:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6beab930-d75f-51cc-93e1-391f56adf233 with identifier: LC31591
2025-12-05 17:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6beab930-d75f-51cc-93e1-391f56adf233 with identifier: LC31591 to the API
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aa23758c7b973581e3076633841e415a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2025-12-06T16:01:38Z',
'fuel_type': 'diesel',
'id': '6beab930-d75f-51cc-93e1-391f56adf233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC31591',
'listing': 'auction',
'location': 'FR, Escaudain',
'make': 'Ford',
'model': 'Kuga',
'odometer': 136003,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aabe669732876552e134fb8a2dc2a118.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_9ff305f93a16d860eabda33f1bb46ba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4ac9d4be58279991b0aefc27db5c0909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_e5ee1a08b7a9a7643bcfee9710181a41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_86653e924624237f4c30a0eba6811ca4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_df5bb8eba2f975e1e61474be832a7366.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2815024,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_aa23758c7b973581e3076633841e415a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3238390,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_85d90623a4413ef90dd275ec18ada27f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_920ebf856d3a82ea0932fe5decf17262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_c6e626f855e6506a44c1fa5be67770ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2879748,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_170412a66902b0e091d35b8cd7e7370d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_96c5caf5adce540f8a6f1505f29f0946.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_2aefd3438528246431e79d9d9e43f027.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_26186a5f499e66e2f8401b5a6bd737b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_4f97d15cdaf2f485338376797f8bd9aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6beab930-d75f-51cc-93e1-391f56adf233/6beab930-d75f-51cc-93e1-391f56adf233_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 70827,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/26/f0268044894a74b9339d30cd6407a482/pa/LC31591_70ab3f36b1904a689be1f0ee3099ff2a.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2021}
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC31591%27 HTTP/1.1" 200 None
2025-12-05 17:12:41 [auto1.fr] INFO: Saving data for LC31591: {'created_time': 1764954761.558742, 'last_price_update_time': 1764954761.558751, 'auction_closing_time': 1765036898.0}
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LC31591') HTTP/1.1" 204 0
2025-12-05 17:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1e80063a2c252aa17c09e750d55a67c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d163d0>
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_1b23c69c7909684a23d62109cb0249de.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1b23c69c7909684a23d62109cb0249de.jpg saved to cache
2025-12-05 17:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d6c490>
2025-12-05 17:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_fd70901dad3fe0f586300b795ef2c136.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd70901dad3fe0f586300b795ef2c136.jpg saved to cache
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:42 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:12:42 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:12:42 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:12:42 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cc590>
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_15.png HTTP/1.1" 201 0
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_7076d3a084eddfa5fea2d5a99d35c2d2.png') HTTP/1.1" 204 0
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_7076d3a084eddfa5fea2d5a99d35c2d2.png saved to cache
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42c82ac5-df85-5b00-a4bc-7b0dd21df938 with identifier: NC37303
2025-12-05 17:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42c82ac5-df85-5b00-a4bc-7b0dd21df938 with scrape type 2
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42c82ac5-df85-5b00-a4bc-7b0dd21df938 with scrape type 2
2025-12-05 17:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 42c82ac5-df85-5b00-a4bc-7b0dd21df938, identifier: NC37303
2025-12-05 17:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b74a9281-2069-5ec5-801d-c24f0bf604c4 with identifier: RX01417
2025-12-05 17:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74a9281-2069-5ec5-801d-c24f0bf604c4 with scrape type 1
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b74a9281-2069-5ec5-801d-c24f0bf604c4
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_6be0ac5d5200a4c81933cd902495b855.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6be0ac5d5200a4c81933cd902495b855.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_a61cf2f156fee6db3ae2b073dcf81599.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_a61cf2f156fee6db3ae2b073dcf81599.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_1d1ccd99c85ed047c56a2df5b459b7bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_1d1ccd99c85ed047c56a2df5b459b7bb.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_214cb26b4443b07116cb0741288f8b56.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_214cb26b4443b07116cb0741288f8b56.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_ab66987f1587e0fdeff1ae43b20fd886.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_ab66987f1587e0fdeff1ae43b20fd886.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_69a86346f3547b9a4db2c0fdf75d1808.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_69a86346f3547b9a4db2c0fdf75d1808.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_6393d1873faf6c1bc546ba381007023f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6393d1873faf6c1bc546ba381007023f.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_35aee23bd17ef867a7505916df5a1553.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_35aee23bd17ef867a7505916df5a1553.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_534fe00e16e8d978a43b30fec825b046.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_534fe00e16e8d978a43b30fec825b046.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_f1e60aeb9d84a72bfc1cd07b30258db1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_f1e60aeb9d84a72bfc1cd07b30258db1.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_8eb4463fcf5b9c6be8095355658258da.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_8eb4463fcf5b9c6be8095355658258da.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_6f04f69583fedfa6156695891302cefd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6f04f69583fedfa6156695891302cefd.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_e1ba68001711402568b716a35bd4c4c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_e1ba68001711402568b716a35bd4c4c0.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_b10c1d184aa6590cd6e48f55966fda25.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_b10c1d184aa6590cd6e48f55966fda25.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_f94a70027ac535a3f997c4e520b96c0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_f94a70027ac535a3f997c4e520b96c0a.jpg already downloaded
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd6%252Fb0d61aefa3185984f14ae710a626575d%252Fpa%252FRX01417_322cb1495b2a724f0d2ecc83ee297d3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_322cb1495b2a724f0d2ecc83ee297d3f.jpg already downloaded
2025-12-05 17:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b74a9281-2069-5ec5-801d-c24f0bf604c4, identifier: RX01417
2025-12-05 17:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 42c82ac5-df85-5b00-a4bc-7b0dd21df938 with identifier: NC37303
2025-12-05 17:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 42c82ac5-df85-5b00-a4bc-7b0dd21df938 with identifier: NC37303
2025-12-05 17:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 73183, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nc37303', 'expiration_date': '2025-12-06t16:31:53z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '42c82ac5-df85-5b00-a4bc-7b0dd21df938', 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 73183}
Failed validating None in schema:
False
On instance:
{'age_in_months': 92,
'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:31:53z',
'fuel_type': 'petrol',
'id': '42c82ac5-df85-5b00-a4bc-7b0dd21df938',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nc37303',
'listing': 'auction',
'location': 'fr, la chapelle longueville',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 73183,
'odometer_in_km': 73183,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech feel',
'transmission': 'automatic',
'trim': 'feel',
'year': 2018}
2025-12-05 17:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 42c82ac5-df85-5b00-a4bc-7b0dd21df938 spider: auto1.fr
2025-12-05 17:12:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 42c82ac5-df85-5b00-a4bc-7b0dd21df938 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 73183, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nc37303', 'expiration_date': '2025-12-06t16:31:53z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '42c82ac5-df85-5b00-a4bc-7b0dd21df938', 'current_year_diff': 7, 'age_in_months': 92, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 73183}
Failed validating None in schema:
False
On instance:
{'age_in_months': 92,
'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'black',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:31:53z',
'fuel_type': 'petrol',
'id': '42c82ac5-df85-5b00-a4bc-7b0dd21df938',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nc37303',
'listing': 'auction',
'location': 'fr, la chapelle longueville',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 73183,
'odometer_in_km': 73183,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech feel',
'transmission': 'automatic',
'trim': 'feel',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:31:53Z',
'fuel_type': 'petrol',
'id': '42c82ac5-df85-5b00-a4bc-7b0dd21df938',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC37303',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 73183,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Feel',
'transmission': 'automatic',
'trim': 'Feel',
'year': 2018}
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC37303%27 HTTP/1.1" 200 None
2025-12-05 17:12:43 [auto1.fr] INFO: Saving data for NC37303: {'auction_closing_time': 1765038713.0, 'created_time': 1764309732.982701, 'last_price_update_time': 1764954763.043384}
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC37303') HTTP/1.1" 204 0
2025-12-05 17:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b74a9281-2069-5ec5-801d-c24f0bf604c4 with identifier: RX01417
2025-12-05 17:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b74a9281-2069-5ec5-801d-c24f0bf604c4 with identifier: RX01417
2025-12-05 17:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b74a9281-2069-5ec5-801d-c24f0bf604c4 with identifier: RX01417 to the API
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX01417>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2025-12-06T16:55:30Z',
'fuel_type': 'petrol',
'id': 'b74a9281-2069-5ec5-801d-c24f0bf604c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX01417',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 74274,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6be0ac5d5200a4c81933cd902495b855.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_a61cf2f156fee6db3ae2b073dcf81599.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_1d1ccd99c85ed047c56a2df5b459b7bb.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_214cb26b4443b07116cb0741288f8b56.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_ab66987f1587e0fdeff1ae43b20fd886.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_69a86346f3547b9a4db2c0fdf75d1808.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6393d1873faf6c1bc546ba381007023f.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_35aee23bd17ef867a7505916df5a1553.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_534fe00e16e8d978a43b30fec825b046.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_f1e60aeb9d84a72bfc1cd07b30258db1.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_8eb4463fcf5b9c6be8095355658258da.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6f04f69583fedfa6156695891302cefd.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_e1ba68001711402568b716a35bd4c4c0.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_b10c1d184aa6590cd6e48f55966fda25.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_f94a70027ac535a3f997c4e520b96c0a.jpg',
'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_322cb1495b2a724f0d2ecc83ee297d3f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6be0ac5d5200a4c81933cd902495b855.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_a61cf2f156fee6db3ae2b073dcf81599.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_1d1ccd99c85ed047c56a2df5b459b7bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_214cb26b4443b07116cb0741288f8b56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_ab66987f1587e0fdeff1ae43b20fd886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_69a86346f3547b9a4db2c0fdf75d1808.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6393d1873faf6c1bc546ba381007023f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_35aee23bd17ef867a7505916df5a1553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_534fe00e16e8d978a43b30fec825b046.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_f1e60aeb9d84a72bfc1cd07b30258db1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_8eb4463fcf5b9c6be8095355658258da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_6f04f69583fedfa6156695891302cefd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_e1ba68001711402568b716a35bd4c4c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_b10c1d184aa6590cd6e48f55966fda25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_f94a70027ac535a3f997c4e520b96c0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74a9281-2069-5ec5-801d-c24f0bf604c4/b74a9281-2069-5ec5-801d-c24f0bf604c4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/d6/b0d61aefa3185984f14ae710a626575d/pa/RX01417_322cb1495b2a724f0d2ecc83ee297d3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-15',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0 X-Play',
'transmission': 'manual',
'trim': 'X-Play',
'year': 2016}
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX01417%27 HTTP/1.1" 200 None
2025-12-05 17:12:43 [auto1.fr] INFO: Saving data for RX01417: {'created_time': 1764954763.38608, 'last_price_update_time': 1764954763.386089, 'auction_closing_time': 1765040130.0}
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX01417') HTTP/1.1" 204 0
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d13f10>
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_1e80063a2c252aa17c09e750d55a67c3.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1e80063a2c252aa17c09e750d55a67c3.jpg saved to cache
2025-12-05 17:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_80e38fc49f49292f1fed489e5d618ed1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_44424ca0c3d51ca64b1044e34301fe2a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_b5be0627a26f1cf209b1f6834f5b3368.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6564ace96235854819f746345f44c948.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_0900814d6023628fc77c00925c12ffcb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c576a510>
2025-12-05 17:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_80e38fc49f49292f1fed489e5d618ed1.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_80e38fc49f49292f1fed489e5d618ed1.jpg saved to cache
2025-12-05 17:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57b6f50>
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_44424ca0c3d51ca64b1044e34301fe2a.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_44424ca0c3d51ca64b1044e34301fe2a.jpg saved to cache
2025-12-05 17:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY85660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM88869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD81006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN83109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5810f50>
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_b5be0627a26f1cf209b1f6834f5b3368.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_b5be0627a26f1cf209b1f6834f5b3368.jpg saved to cache
2025-12-05 17:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bd4e50>
2025-12-05 17:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F73%252F91736e221aff8576d5160f9e49e65b9c%252Fpa%252FGC29401_6564ace96235854819f746345f44c948.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6564ace96235854819f746345f44c948.jpg saved to cache
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7
2025-12-05 17:12:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc3ca44e-a8c9-5266-a580-d49fa4f84ff7, skipping ID generation
2025-12-05 17:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 with scrape type 1
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 from tracking dictionaries
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 sending to next pipeline
2025-12-05 17:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc3ca44e-a8c9-5266-a580-d49fa4f84ff7, identifier: GC29401
2025-12-05 17:12:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582da10>
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F52%252F9b52172c2962432155fdf7e470e1e0f9%252Fpa%252FZX29888_0900814d6023628fc77c00925c12ffcb.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_0900814d6023628fc77c00925c12ffcb.jpg saved to cache
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db62b88f-b379-595e-a248-3b01d6b301e0
2025-12-05 17:12:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db62b88f-b379-595e-a248-3b01d6b301e0, skipping ID generation
2025-12-05 17:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db62b88f-b379-595e-a248-3b01d6b301e0 with scrape type 1
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db62b88f-b379-595e-a248-3b01d6b301e0 from tracking dictionaries
2025-12-05 17:12:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db62b88f-b379-595e-a248-3b01d6b301e0 sending to next pipeline
2025-12-05 17:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db62b88f-b379-595e-a248-3b01d6b301e0, identifier: ZX29888
2025-12-05 17:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 with identifier: GC29401
2025-12-05 17:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 with identifier: GC29401
2025-12-05 17:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc3ca44e-a8c9-5266-a580-d49fa4f84ff7 with identifier: GC29401 to the API
2025-12-05 17:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6564ace96235854819f746345f44c948.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:28:30Z',
'fuel_type': 'diesel',
'id': 'fc3ca44e-a8c9-5266-a580-d49fa4f84ff7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC29401',
'listing': 'auction',
'location': 'FR, Montigny-le-Bretonneux',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 102344,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_94574c4af903d772291aef2a951fde5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3171093,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6564ace96235854819f746345f44c948.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_ecd0ed323e16b536ab3b6641f7961c03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_289153f702541ad7a493afc8f2e8f02b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_9fced03a801377af558d62044240979b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_3acc8fa0d05ee6b8a5d2b402897141bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_6e526b75860929281392402a6c88a7cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_cea7806f15000be676844a1b9de278bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3459819,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_4ada0169874198235d2e23770de9286f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2645747,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_f7c51ca0e5a306d008926422c74aa847.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_82cec1d64928b9bdf1a6f9dc8e5d062c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571401,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_20f163fd08321a95494d27a4a1955e1e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_73a225e7686be806c874168fe6052f12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_16ea81ce6a4c18ef17dba7a3f4605f00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_aa1d06ba410d051e79389b5fdf4c0727.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc3ca44e-a8c9-5266-a580-d49fa4f84ff7/fc3ca44e-a8c9-5266-a580-d49fa4f84ff7_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/73/91736e221aff8576d5160f9e49e65b9c/pa/GC29401_2a3df7983cb83a5c977677efcd255255.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-19',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC29401%27 HTTP/1.1" 200 None
2025-12-05 17:12:46 [auto1.fr] INFO: Saving data for GC29401: {'created_time': 1764954766.137757, 'last_price_update_time': 1764954766.137767, 'auction_closing_time': 1765038510.0}
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC29401') HTTP/1.1" 204 0
2025-12-05 17:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db62b88f-b379-595e-a248-3b01d6b301e0 with identifier: ZX29888
2025-12-05 17:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db62b88f-b379-595e-a248-3b01d6b301e0 with identifier: ZX29888
2025-12-05 17:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: db62b88f-b379-595e-a248-3b01d6b301e0 with identifier: ZX29888 to the API
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_0900814d6023628fc77c00925c12ffcb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 320,
'expiration_date': '2025-12-06T16:24:52Z',
'fuel_type': 'diesel',
'id': 'db62b88f-b379-595e-a248-3b01d6b301e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX29888',
'listing': 'auction',
'location': 'FR, Strasbourg',
'make': 'BMW',
'model': '8er',
'odometer': 105970,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c1f19e2ec647cac423686e1cd2223fc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2c4a3cdbe85f97b87e6c8ea331887da1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546014,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_80e38fc49f49292f1fed489e5d618ed1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_2e740434c65dd7e7427d78945b9bb472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_536448882aa007f9dad8fe97ba56098c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_c91f2de7cbdb778f1c64647331ed4030.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd8b2fe7a8982dbccbf8979009a642a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2401662,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_44424ca0c3d51ca64b1044e34301fe2a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2454337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_0900814d6023628fc77c00925c12ffcb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_e4389762245c50b8c4fdd0a17b6ae353.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439029,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_b5be0627a26f1cf209b1f6834f5b3368.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_4fc53059502288161e1c245c9e9cac77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1b23c69c7909684a23d62109cb0249de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_1e80063a2c252aa17c09e750d55a67c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_fd70901dad3fe0f586300b795ef2c136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db62b88f-b379-595e-a248-3b01d6b301e0/db62b88f-b379-595e-a248-3b01d6b301e0_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 87515,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/img9b/52/9b52172c2962432155fdf7e470e1e0f9/pa/ZX29888_7076d3a084eddfa5fea2d5a99d35c2d2.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-29',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 8er 840d xDrive M Technic Sport',
'transmission': 'automatic',
'trim': 'xDrive M Technic Sport',
'year': 2019}
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX29888%27 HTTP/1.1" 200 None
2025-12-05 17:12:46 [auto1.fr] INFO: Saving data for ZX29888: {'created_time': 1764954766.489344, 'last_price_update_time': 1764954766.489355, 'auction_closing_time': 1765038292.0}
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZX29888') HTTP/1.1" 204 0
2025-12-05 17:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE79123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM52507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC12795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU62018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT75672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL16810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN83109> (referer: https://www.auto1.com/v1/car-details-view/UN83109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF47019/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT91443> (referer: https://www.auto1.com/v1/car-details-view/MT91443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a with identifier: UN83109
2025-12-05 17:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a with scrape type 1
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_81c9b545d58deeb2252aa2e0b1e02e66.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_81c9b545d58deeb2252aa2e0b1e02e66.jpg not downloaded yet
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_def11fa383c83a2bcf64c09b4e39309e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_def11fa383c83a2bcf64c09b4e39309e.jpg not downloaded yet
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_92d8d730cef6d71c30c60530cd63cab4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_92d8d730cef6d71c30c60530cd63cab4.jpg not downloaded yet
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_9482cced65fd4888ea7e56ba83526b91.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_9482cced65fd4888ea7e56ba83526b91.jpg not downloaded yet
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_8c83ed19956f7bf9f087818080ca0b4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_8c83ed19956f7bf9f087818080ca0b4f.jpg not downloaded yet
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_d787ec61e9c572c588eb5cf0c5f0e908.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_d787ec61e9c572c588eb5cf0c5f0e908.jpg not downloaded yet
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_06711751c1899f03d69cf84003f1a215.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_06711751c1899f03d69cf84003f1a215.jpg not downloaded yet
2025-12-05 17:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b5099f4-6133-56e8-9be9-e28b57479eb7 with identifier: MT91443
2025-12-05 17:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b5099f4-6133-56e8-9be9-e28b57479eb7 with scrape type 2
2025-12-05 17:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b5099f4-6133-56e8-9be9-e28b57479eb7 with scrape type 2
2025-12-05 17:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b5099f4-6133-56e8-9be9-e28b57479eb7, identifier: MT91443
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_6cef56bdf8b3ff99fb9fdf9275e0e045.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_6cef56bdf8b3ff99fb9fdf9275e0e045.jpg not downloaded yet
2025-12-05 17:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b5099f4-6133-56e8-9be9-e28b57479eb7 with identifier: MT91443
2025-12-05 17:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b5099f4-6133-56e8-9be9-e28b57479eb7 with identifier: MT91443
2025-12-05 17:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b5099f4-6133-56e8-9be9-e28b57479eb7 with identifier: MT91443 to the API
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MT91443>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:22:01Z',
'fuel_type': 'petrol',
'id': '8b5099f4-6133-56e8-9be9-e28b57479eb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT91443',
'listing': 'auction',
'location': 'FR, Bussy-Lettrée',
'make': 'Renault',
'model': 'Espace',
'odometer': 117184,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-09',
'seats_number': 7,
'seller_name': None,
'title': 'Renault Espace 1.8 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2019}
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT91443%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [auto1.fr] INFO: Saving data for MT91443: {'auction_closing_time': 1765038121.0, 'created_time': 1764005023.468082, 'last_price_update_time': 1764954768.318248}
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT91443') HTTP/1.1" 204 0
2025-12-05 17:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR88466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_599c312eba0c1f5841ddef70f1f169fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_599c312eba0c1f5841ddef70f1f169fa.jpg not downloaded yet
2025-12-05 17:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT03578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD81006> (referer: https://www.auto1.com/v1/car-details-view/JD81006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_cdaa35aad654a8fcc490dc706d96274a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_cdaa35aad654a8fcc490dc706d96274a.jpg not downloaded yet
2025-12-05 17:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_6b8e5d2a7029dbd0283dacbd55cdce6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_6b8e5d2a7029dbd0283dacbd55cdce6f.jpg not downloaded yet
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_583311b76de8951c3a38cb2a17044664.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_583311b76de8951c3a38cb2a17044664.jpg not downloaded yet
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_06cf945f4576805096ebf16a3862475e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_06cf945f4576805096ebf16a3862475e.jpg not downloaded yet
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_86a4f4e90343b6b1d6f65b1448a7adb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_86a4f4e90343b6b1d6f65b1448a7adb7.jpg not downloaded yet
2025-12-05 17:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_599c312eba0c1f5841ddef70f1f169fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_19d2429fc6811c9151511ff2c8e97a81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_19d2429fc6811c9151511ff2c8e97a81.jpg not downloaded yet
2025-12-05 17:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_06711751c1899f03d69cf84003f1a215.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_09f3fc0780799b4460e0566d5e43021a.png%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_09f3fc0780799b4460e0566d5e43021a.png not downloaded yet
2025-12-05 17:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5605537-9183-53b5-8431-161c89fc1ac7 with identifier: JD81006
2025-12-05 17:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5605537-9183-53b5-8431-161c89fc1ac7 with scrape type 1
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_2a253c77bd4b8e399a35ae5b597d83e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_2a253c77bd4b8e399a35ae5b597d83e6.jpg not downloaded yet
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_fdd8bbb0b9a1e5a1020d3b51be7df22f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_fdd8bbb0b9a1e5a1020d3b51be7df22f.jpg not downloaded yet
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_6b10b7cc15774f369893d2aa8751096a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_6b10b7cc15774f369893d2aa8751096a.jpg not downloaded yet
2025-12-05 17:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM88869> (referer: https://www.auto1.com/v1/car-details-view/MM88869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_d6ab7c6cd36df0b1efef26cc55317705.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_d6ab7c6cd36df0b1efef26cc55317705.jpg not downloaded yet
2025-12-05 17:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_7d253bfe3a1417e08ebc4b003571dcb6.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_7d253bfe3a1417e08ebc4b003571dcb6.jpg not downloaded yet
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1dbd0>
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a/5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_599c312eba0c1f5841ddef70f1f169fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_599c312eba0c1f5841ddef70f1f169fa.jpg saved to cache
2025-12-05 17:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5882f10>
2025-12-05 17:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a/5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_06711751c1899f03d69cf84003f1a215.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_06711751c1899f03d69cf84003f1a215.jpg saved to cache
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_a7f700bab0031ccf3660a9746cf4ade9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_a7f700bab0031ccf3660a9746cf4ade9.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_1bcccca4405927280c24489d2707a09e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_1bcccca4405927280c24489d2707a09e.jpg not downloaded yet
2025-12-05 17:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX72651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP73436/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_3549b26987881f3a6bf3b919f412d312.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_3549b26987881f3a6bf3b919f412d312.jpg not downloaded yet
2025-12-05 17:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfc7c183-812f-5f9b-bbe2-affce6a2804d with identifier: MM88869
2025-12-05 17:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc7c183-812f-5f9b-bbe2-affce6a2804d with scrape type 1
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_6d59e154de5da0c6eb12a887c2fa1d71.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_6d59e154de5da0c6eb12a887c2fa1d71.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_cb63ab69ca65fede947ced70cd2dbeec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_cb63ab69ca65fede947ced70cd2dbeec.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg not downloaded yet
2025-12-05 17:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX56394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_232d151c67a6b07a9c46f261f07ac391.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_232d151c67a6b07a9c46f261f07ac391.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_ce231387988d913ac1a914a494f46125.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_ce231387988d913ac1a914a494f46125.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_db58c2654f6e379fe9141779178b99a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_db58c2654f6e379fe9141779178b99a1.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_47be3b0b9726f67f3f1668d22f45b8b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47be3b0b9726f67f3f1668d22f45b8b3.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_37405158d90f74e3b39335e6b9d3268c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_37405158d90f74e3b39335e6b9d3268c.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_57d8a88ac203bbf86fa1cda1d89b81a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d8a88ac203bbf86fa1cda1d89b81a8.jpg not downloaded yet
2025-12-05 17:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_6d59e154de5da0c6eb12a887c2fa1d71.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_e4b1a30fbb385e58384a23f7cfc3a763.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_e4b1a30fbb385e58384a23f7cfc3a763.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_68989ede31efcabf574182f7f3757549.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_68989ede31efcabf574182f7f3757549.jpg not downloaded yet
2025-12-05 17:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_6cef56bdf8b3ff99fb9fdf9275e0e045.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_edb47c4e426aae470664cd0532fb767c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_edb47c4e426aae470664cd0532fb767c.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_800a2f247eeaa3bf6cb9d5dd3e562121.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_800a2f247eeaa3bf6cb9d5dd3e562121.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_3ab506a994e7d8b7c91fd726121633cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_3ab506a994e7d8b7c91fd726121633cf.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_9454bd490f9dcf0aa84ca305ca5b0a34.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9454bd490f9dcf0aa84ca305ca5b0a34.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_ae505543bfbe3776898a4203b577cd65.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_ae505543bfbe3776898a4203b577cd65.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_fcb890eadd27b9bc1e63fe6bb614d777.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_fcb890eadd27b9bc1e63fe6bb614d777.jpg not downloaded yet
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_f2238535d6ccba604697c1ff36f1b03a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f2238535d6ccba604697c1ff36f1b03a.jpg not downloaded yet
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5828c90>
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_6d59e154de5da0c6eb12a887c2fa1d71.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_6d59e154de5da0c6eb12a887c2fa1d71.jpg saved to cache
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_47f745a88845e52826bfa0eb7854b29e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47f745a88845e52826bfa0eb7854b29e.jpg not downloaded yet
2025-12-05 17:12:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ab8e50>
2025-12-05 17:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a/5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_6cef56bdf8b3ff99fb9fdf9275e0e045.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_6cef56bdf8b3ff99fb9fdf9275e0e045.jpg saved to cache
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_57d325102bfba043071137fa232837ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d325102bfba043071137fa232837ff.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_55cf6c0351e3ae09bdffe9c0c6a974d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_55cf6c0351e3ae09bdffe9c0c6a974d4.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_aa56cf590c3f363a14e44f0d47ea3321.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_aa56cf590c3f363a14e44f0d47ea3321.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_3afc50235ddcc8ffb4b566ee1abe6236.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_3afc50235ddcc8ffb4b566ee1abe6236.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_d688160e179440605943d8d298e317ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_d688160e179440605943d8d298e317ac.jpg not downloaded yet
2025-12-05 17:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_6b10b7cc15774f369893d2aa8751096a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_f4b731c5c93a90efd0ee99c4b6e753e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f4b731c5c93a90efd0ee99c4b6e753e0.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_4ae6828ec3efb48f5e8e164c0b843204.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_4ae6828ec3efb48f5e8e164c0b843204.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_9a1004413a509fc18091f829bc20dee0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9a1004413a509fc18091f829bc20dee0.jpg not downloaded yet
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_e1e56b61afaa16c80bf1470e71d7acfb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_e1e56b61afaa16c80bf1470e71d7acfb.jpg not downloaded yet
2025-12-05 17:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_1bcccca4405927280c24489d2707a09e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_a7f700bab0031ccf3660a9746cf4ade9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_3afc50235ddcc8ffb4b566ee1abe6236.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5926e90>
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_6b10b7cc15774f369893d2aa8751096a.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_6b10b7cc15774f369893d2aa8751096a.jpg saved to cache
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_e1e56b61afaa16c80bf1470e71d7acfb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e66ad0>
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_1bcccca4405927280c24489d2707a09e.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_1bcccca4405927280c24489d2707a09e.jpg saved to cache
2025-12-05 17:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579ed90>
2025-12-05 17:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_a7f700bab0031ccf3660a9746cf4ade9.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_a7f700bab0031ccf3660a9746cf4ade9.jpg saved to cache
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c579df10>
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_3afc50235ddcc8ffb4b566ee1abe6236.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_3afc50235ddcc8ffb4b566ee1abe6236.jpg saved to cache
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_4ae6828ec3efb48f5e8e164c0b843204.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f4b731c5c93a90efd0ee99c4b6e753e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9a1004413a509fc18091f829bc20dee0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY85660> (referer: https://www.auto1.com/v1/car-details-view/GY85660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT75672> (referer: https://www.auto1.com/v1/car-details-view/YT75672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4daff90>
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_19.jpg HTTP/1.1" 201 0
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_e1e56b61afaa16c80bf1470e71d7acfb.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_e1e56b61afaa16c80bf1470e71d7acfb.jpg saved to cache
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_55cf6c0351e3ae09bdffe9c0c6a974d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_d688160e179440605943d8d298e317ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_aa56cf590c3f363a14e44f0d47ea3321.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585ea50>
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_4ae6828ec3efb48f5e8e164c0b843204.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_4ae6828ec3efb48f5e8e164c0b843204.jpg saved to cache
2025-12-05 17:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f3910>
2025-12-05 17:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_f4b731c5c93a90efd0ee99c4b6e753e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f4b731c5c93a90efd0ee99c4b6e753e0.jpg saved to cache
2025-12-05 17:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d37490>
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_9a1004413a509fc18091f829bc20dee0.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9a1004413a509fc18091f829bc20dee0.jpg saved to cache
2025-12-05 17:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d55811-d76a-5a12-99fc-bf6a6012ff10 with identifier: GY85660
2025-12-05 17:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d55811-d76a-5a12-99fc-bf6a6012ff10 with scrape type 2
2025-12-05 17:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d55811-d76a-5a12-99fc-bf6a6012ff10 with scrape type 2
2025-12-05 17:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05d55811-d76a-5a12-99fc-bf6a6012ff10, identifier: GY85660
2025-12-05 17:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998a06b8-9357-5adc-81e4-e0d4d090c0aa with identifier: YT75672
2025-12-05 17:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998a06b8-9357-5adc-81e4-e0d4d090c0aa with scrape type 2
2025-12-05 17:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998a06b8-9357-5adc-81e4-e0d4d090c0aa with scrape type 2
2025-12-05 17:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 998a06b8-9357-5adc-81e4-e0d4d090c0aa, identifier: YT75672
2025-12-05 17:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05d55811-d76a-5a12-99fc-bf6a6012ff10 with identifier: GY85660
2025-12-05 17:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05d55811-d76a-5a12-99fc-bf6a6012ff10 with identifier: GY85660
2025-12-05 17:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141818 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
141818
2025-12-05 17:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 05d55811-d76a-5a12-99fc-bf6a6012ff10 spider: auto1.fr
2025-12-05 17:12:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 05d55811-d76a-5a12-99fc-bf6a6012ff10 due to rule: high_mileage_for_make.json, error: 141818 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
141818
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 165,
'expiration_date': '2025-12-06T16:00:44Z',
'fuel_type': 'petrol',
'id': '05d55811-d76a-5a12-99fc-bf6a6012ff10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY85660',
'listing': 'auction',
'location': 'FR, MIRAMAS',
'make': 'Peugeot',
'model': '3008',
'odometer': 141818,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2018}
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY85660%27 HTTP/1.1" 200 None
2025-12-05 17:12:53 [auto1.fr] INFO: Saving data for GY85660: {'auction_closing_time': 1765036844.0, 'created_time': 1762275738.200226, 'last_price_update_time': 1764954773.025047}
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GY85660') HTTP/1.1" 204 0
2025-12-05 17:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 998a06b8-9357-5adc-81e4-e0d4d090c0aa with identifier: YT75672
2025-12-05 17:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 998a06b8-9357-5adc-81e4-e0d4d090c0aa with identifier: YT75672
2025-12-05 17:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 93646, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt75672', 'expiration_date': '2025-12-06t16:17:48z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 95, 'id': '998a06b8-9357-5adc-81e4-e0d4d090c0aa', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 93646}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:17:48z',
'fuel_type': 'petrol',
'id': '998a06b8-9357-5adc-81e4-e0d4d090c0aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt75672',
'listing': 'auction',
'location': 'fr, nanteuil-le-haudouin',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 93646,
'odometer_in_km': 93646,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp style',
'transmission': 'manual',
'trim': 'style',
'year': 2016}
2025-12-05 17:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 998a06b8-9357-5adc-81e4-e0d4d090c0aa spider: auto1.fr
2025-12-05 17:12:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 998a06b8-9357-5adc-81e4-e0d4d090c0aa due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 93646, 'odometer_reading_unit': 'km', 'registration_date': '2016-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt75672', 'expiration_date': '2025-12-06t16:17:48z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2016, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 95, 'id': '998a06b8-9357-5adc-81e4-e0d4d090c0aa', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 93646}
Failed validating None in schema:
False
On instance:
{'age_in_months': 107,
'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'blue',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:17:48z',
'fuel_type': 'petrol',
'id': '998a06b8-9357-5adc-81e4-e0d4d090c0aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yt75672',
'listing': 'auction',
'location': 'fr, nanteuil-le-haudouin',
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 93646,
'odometer_in_km': 93646,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 1.2 e-thp style',
'transmission': 'manual',
'trim': 'style',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:17:48Z',
'fuel_type': 'petrol',
'id': '998a06b8-9357-5adc-81e4-e0d4d090c0aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT75672',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Peugeot',
'model': '308',
'odometer': 93646,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT75672%27 HTTP/1.1" 200 None
2025-12-05 17:12:53 [auto1.fr] INFO: Saving data for YT75672: {'auction_closing_time': 1765037868.0, 'created_time': 1764050477.120687, 'last_price_update_time': 1764954773.239363}
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT75672') HTTP/1.1" 204 0
2025-12-05 17:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47f745a88845e52826bfa0eb7854b29e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d325102bfba043071137fa232837ff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d1ef90>
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_55cf6c0351e3ae09bdffe9c0c6a974d4.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_55cf6c0351e3ae09bdffe9c0c6a974d4.jpg saved to cache
2025-12-05 17:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf6850>
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_d688160e179440605943d8d298e317ac.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_d688160e179440605943d8d298e317ac.jpg saved to cache
2025-12-05 17:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cf4090>
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_aa56cf590c3f363a14e44f0d47ea3321.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_aa56cf590c3f363a14e44f0d47ea3321.jpg saved to cache
2025-12-05 17:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f2238535d6ccba604697c1ff36f1b03a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_ae505543bfbe3776898a4203b577cd65.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_fcb890eadd27b9bc1e63fe6bb614d777.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c582bb90>
2025-12-05 17:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_47f745a88845e52826bfa0eb7854b29e.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47f745a88845e52826bfa0eb7854b29e.jpg saved to cache
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b19650>
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_57d325102bfba043071137fa232837ff.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d325102bfba043071137fa232837ff.jpg saved to cache
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_3ab506a994e7d8b7c91fd726121633cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9454bd490f9dcf0aa84ca305ca5b0a34.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5967350>
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_f2238535d6ccba604697c1ff36f1b03a.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f2238535d6ccba604697c1ff36f1b03a.jpg saved to cache
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575e210>
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_ae505543bfbe3776898a4203b577cd65.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_ae505543bfbe3776898a4203b577cd65.jpg saved to cache
2025-12-05 17:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c63c90>
2025-12-05 17:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_fcb890eadd27b9bc1e63fe6bb614d777.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_fcb890eadd27b9bc1e63fe6bb614d777.jpg saved to cache
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_edb47c4e426aae470664cd0532fb767c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_800a2f247eeaa3bf6cb9d5dd3e562121.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_68989ede31efcabf574182f7f3757549.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU62018> (referer: https://www.auto1.com/v1/car-details-view/BU62018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57c3790>
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_3ab506a994e7d8b7c91fd726121633cf.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_3ab506a994e7d8b7c91fd726121633cf.jpg saved to cache
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58905d0>
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_9454bd490f9dcf0aa84ca305ca5b0a34.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9454bd490f9dcf0aa84ca305ca5b0a34.jpg saved to cache
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47be3b0b9726f67f3f1668d22f45b8b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d8a88ac203bbf86fa1cda1d89b81a8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_e4b1a30fbb385e58384a23f7cfc3a763.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c681d0>
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_edb47c4e426aae470664cd0532fb767c.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_edb47c4e426aae470664cd0532fb767c.jpg saved to cache
2025-12-05 17:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a1fd10>
2025-12-05 17:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_800a2f247eeaa3bf6cb9d5dd3e562121.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_800a2f247eeaa3bf6cb9d5dd3e562121.jpg saved to cache
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58762d0>
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_68989ede31efcabf574182f7f3757549.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_68989ede31efcabf574182f7f3757549.jpg saved to cache
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8869283-35dd-5d13-aebb-0c57bc907496 with identifier: BU62018
2025-12-05 17:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8869283-35dd-5d13-aebb-0c57bc907496 with scrape type 1
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_d58086d75205177a641433afd0ab18e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg not downloaded yet
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_0b72823d906125d7e487d74b0769e980.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg not downloaded yet
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c788f610>
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_47be3b0b9726f67f3f1668d22f45b8b3.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47be3b0b9726f67f3f1668d22f45b8b3.jpg saved to cache
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c588e290>
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_57d8a88ac203bbf86fa1cda1d89b81a8.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d8a88ac203bbf86fa1cda1d89b81a8.jpg saved to cache
2025-12-05 17:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bd5290>
2025-12-05 17:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_e4b1a30fbb385e58384a23f7cfc3a763.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_e4b1a30fbb385e58384a23f7cfc3a763.jpg saved to cache
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg not downloaded yet
2025-12-05 17:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_ce231387988d913ac1a914a494f46125.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_1fa5d2e798e174782b2656439f8f35ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg not downloaded yet
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg not downloaded yet
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_7487e7971a41e574e2453efdebad2253.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg not downloaded yet
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg not downloaded yet
2025-12-05 17:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5afa750>
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_ce231387988d913ac1a914a494f46125.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_ce231387988d913ac1a914a494f46125.jpg saved to cache
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58efa90>
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F48%252Fe3480e9d51e596d079060316b478717c%252Fpa%252FMM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg saved to cache
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfc7c183-812f-5f9b-bbe2-affce6a2804d
2025-12-05 17:12:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfc7c183-812f-5f9b-bbe2-affce6a2804d, skipping ID generation
2025-12-05 17:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc7c183-812f-5f9b-bbe2-affce6a2804d with scrape type 1
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cfc7c183-812f-5f9b-bbe2-affce6a2804d from tracking dictionaries
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfc7c183-812f-5f9b-bbe2-affce6a2804d sending to next pipeline
2025-12-05 17:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cfc7c183-812f-5f9b-bbe2-affce6a2804d, identifier: MM88869
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_6def34da9070b39701a2ba46d5389d70.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg not downloaded yet
2025-12-05 17:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cfc7c183-812f-5f9b-bbe2-affce6a2804d with identifier: MM88869
2025-12-05 17:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cfc7c183-812f-5f9b-bbe2-affce6a2804d with identifier: MM88869
2025-12-05 17:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cfc7c183-812f-5f9b-bbe2-affce6a2804d with identifier: MM88869 to the API
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2025-12-06T16:39:16Z',
'fuel_type': 'petrol',
'id': 'cfc7c183-812f-5f9b-bbe2-affce6a2804d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM88869',
'listing': 'auction',
'location': 'FR',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 126203,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_6d59e154de5da0c6eb12a887c2fa1d71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_a4b3e07d04ecbb2bfd942c0fb990c653.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_ce231387988d913ac1a914a494f46125.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47be3b0b9726f67f3f1668d22f45b8b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d8a88ac203bbf86fa1cda1d89b81a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_68989ede31efcabf574182f7f3757549.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_800a2f247eeaa3bf6cb9d5dd3e562121.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9454bd490f9dcf0aa84ca305ca5b0a34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_fcb890eadd27b9bc1e63fe6bb614d777.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f2238535d6ccba604697c1ff36f1b03a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_47f745a88845e52826bfa0eb7854b29e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_57d325102bfba043071137fa232837ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_55cf6c0351e3ae09bdffe9c0c6a974d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_aa56cf590c3f363a14e44f0d47ea3321.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_3afc50235ddcc8ffb4b566ee1abe6236.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_d688160e179440605943d8d298e317ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_f4b731c5c93a90efd0ee99c4b6e753e0.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_4ae6828ec3efb48f5e8e164c0b843204.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_9a1004413a509fc18091f829bc20dee0.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc7c183-812f-5f9b-bbe2-affce6a2804d/cfc7c183-812f-5f9b-bbe2-affce6a2804d_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 17757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/48/e3480e9d51e596d079060316b478717c/pa/MM88869_e1e56b61afaa16c80bf1470e71d7acfb.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI ACT Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM88869%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [auto1.fr] INFO: Saving data for MM88869: {'created_time': 1764954778.310984, 'last_price_update_time': 1764954778.310998, 'auction_closing_time': 1765039156.0}
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MM88869') HTTP/1.1" 204 0
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg not downloaded yet
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU28181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c51950>
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_d58086d75205177a641433afd0ab18e0.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg saved to cache
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:12:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg not downloaded yet
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg not downloaded yet
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_a2209f3b8425319bbdb77895a77ff317.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg not downloaded yet
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg not downloaded yet
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg not downloaded yet
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg not downloaded yet
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_900dd34045bd2b70d86680de1a2656cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg not downloaded yet
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_37405158d90f74e3b39335e6b9d3268c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_db58c2654f6e379fe9141779178b99a1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_232d151c67a6b07a9c46f261f07ac391.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bd6510>
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg saved to cache
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:12:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d51750>
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_37405158d90f74e3b39335e6b9d3268c.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_37405158d90f74e3b39335e6b9d3268c.jpg saved to cache
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c575dad0>
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_db58c2654f6e379fe9141779178b99a1.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_db58c2654f6e379fe9141779178b99a1.jpg saved to cache
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58f3610>
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_232d151c67a6b07a9c46f261f07ac391.jpg') HTTP/1.1" 204 0
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_232d151c67a6b07a9c46f261f07ac391.jpg saved to cache
2025-12-05 17:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:12:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5781cd0>
2025-12-05 17:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_0b72823d906125d7e487d74b0769e980.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg saved to cache
2025-12-05 17:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58c2d50>
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_7487e7971a41e574e2453efdebad2253.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg saved to cache
2025-12-05 17:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE79123> (referer: https://www.auto1.com/v1/car-details-view/DE79123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT03578> (referer: https://www.auto1.com/v1/car-details-view/UT03578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:13:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ea1ed0>
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_900dd34045bd2b70d86680de1a2656cd.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg saved to cache
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8924dfcf-73fb-5c48-b94e-2203672bb4e7 with identifier: DE79123
2025-12-05 17:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8924dfcf-73fb-5c48-b94e-2203672bb4e7 with scrape type 2
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8924dfcf-73fb-5c48-b94e-2203672bb4e7 with scrape type 2
2025-12-05 17:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8924dfcf-73fb-5c48-b94e-2203672bb4e7, identifier: DE79123
2025-12-05 17:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf81e385-15d7-5549-9f65-e13bcaba8ea9 with identifier: UT03578
2025-12-05 17:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf81e385-15d7-5549-9f65-e13bcaba8ea9 with scrape type 1
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_781f7b7d8947e4a1c6a0ab4227296de8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_781f7b7d8947e4a1c6a0ab4227296de8.jpg not downloaded yet
2025-12-05 17:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8924dfcf-73fb-5c48-b94e-2203672bb4e7 with identifier: DE79123
2025-12-05 17:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8924dfcf-73fb-5c48-b94e-2203672bb4e7 with identifier: DE79123
2025-12-05 17:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171013 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171013
2025-12-05 17:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8924dfcf-73fb-5c48-b94e-2203672bb4e7 spider: auto1.fr
2025-12-05 17:13:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8924dfcf-73fb-5c48-b94e-2203672bb4e7 due to rule: high_mileage_for_country.json, error: 171013 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
171013
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:24:54Z',
'fuel_type': 'diesel',
'id': '8924dfcf-73fb-5c48-b94e-2203672bb4e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE79123',
'listing': 'auction',
'location': 'FR',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 171013,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-02',
'seats_number': 2,
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE79123%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [auto1.fr] INFO: Saving data for DE79123: {'auction_closing_time': 1765038294.0, 'created_time': 1764004075.299099, 'last_price_update_time': 1764954781.318159}
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE79123') HTTP/1.1" 204 0
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_90cd5cb9474e643bca2c88b722a45673.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_90cd5cb9474e643bca2c88b722a45673.jpg not downloaded yet
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_8dc1d1398cb5f5b745904efebd1cdad2.png%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_8dc1d1398cb5f5b745904efebd1cdad2.png not downloaded yet
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_491bc38778e3d36dae66edc17837695e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_491bc38778e3d36dae66edc17837695e.jpg not downloaded yet
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_eddacbd470073b37aa8607fe8077d3dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_eddacbd470073b37aa8607fe8077d3dc.jpg not downloaded yet
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_a1f1725ce694fb05bea5b0c5cf0e99c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a1f1725ce694fb05bea5b0c5cf0e99c7.jpg not downloaded yet
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_a9d28a7e2a60cee3240f1e7e3965eeee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a9d28a7e2a60cee3240f1e7e3965eeee.jpg not downloaded yet
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59c7750>
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg saved to cache
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eb0f50>
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg saved to cache
2025-12-05 17:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_90cd5cb9474e643bca2c88b722a45673.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_781f7b7d8947e4a1c6a0ab4227296de8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a9d28a7e2a60cee3240f1e7e3965eeee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a1f1725ce694fb05bea5b0c5cf0e99c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb7710>
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_90cd5cb9474e643bca2c88b722a45673.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_90cd5cb9474e643bca2c88b722a45673.jpg saved to cache
2025-12-05 17:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e4e10>
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg saved to cache
2025-12-05 17:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX72651> (referer: https://www.auto1.com/v1/car-details-view/MX72651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR88466> (referer: https://www.auto1.com/v1/car-details-view/SR88466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58bc450>
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_781f7b7d8947e4a1c6a0ab4227296de8.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_781f7b7d8947e4a1c6a0ab4227296de8.jpg saved to cache
2025-12-05 17:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e7590>
2025-12-05 17:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_6def34da9070b39701a2ba46d5389d70.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg saved to cache
2025-12-05 17:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594c4d0>
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_a2209f3b8425319bbdb77895a77ff317.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg saved to cache
2025-12-05 17:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b27590>
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg saved to cache
2025-12-05 17:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d34bd0>
2025-12-05 17:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg saved to cache
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5843010>
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_a9d28a7e2a60cee3240f1e7e3965eeee.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a9d28a7e2a60cee3240f1e7e3965eeee.jpg saved to cache
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ecccd0>
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_a1f1725ce694fb05bea5b0c5cf0e99c7.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a1f1725ce694fb05bea5b0c5cf0e99c7.jpg saved to cache
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX56394> (referer: https://www.auto1.com/v1/car-details-view/TX56394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP73436> (referer: https://www.auto1.com/v1/car-details-view/ZP73436/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8564a471-2b92-56d6-b0e4-98397603e979 with identifier: MX72651
2025-12-05 17:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8564a471-2b92-56d6-b0e4-98397603e979 with scrape type 1
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_8bb6cf047ec992fc18795a1532b66edd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_8bb6cf047ec992fc18795a1532b66edd.jpg not downloaded yet
2025-12-05 17:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3821b69f-fe87-5c77-8274-0af1813546b6 with identifier: SR88466
2025-12-05 17:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3821b69f-fe87-5c77-8274-0af1813546b6 with scrape type 1
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_023e6582f1f13665b2f9153d9015807b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_023e6582f1f13665b2f9153d9015807b.jpg not downloaded yet
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_02a373d16a372f0cde23cfeecdd6523c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_02a373d16a372f0cde23cfeecdd6523c.jpg not downloaded yet
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_70a02ffb3bc554df5d8ab9836fd60869.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_70a02ffb3bc554df5d8ab9836fd60869.jpg not downloaded yet
2025-12-05 17:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2360f9-2e64-578d-aa66-f15bd57cf342 with identifier: TX56394
2025-12-05 17:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2360f9-2e64-578d-aa66-f15bd57cf342 with scrape type 1
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item be2360f9-2e64-578d-aa66-f15bd57cf342
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_a0fff04d0a89b218e16ef7efa6106657.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_a0fff04d0a89b218e16ef7efa6106657.jpg already downloaded
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_5138621dfec4a9e2580cae1c9f6f52cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_5138621dfec4a9e2580cae1c9f6f52cd.jpg already downloaded
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_00ba207a7144456acbac6b9cf0d52c6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_00ba207a7144456acbac6b9cf0d52c6b.jpg already downloaded
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_fa608d83b94f051219684e4ad8e28f81.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_fa608d83b94f051219684e4ad8e28f81.jpg already downloaded
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_980e902ee21a80ece386bb338131a606.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_980e902ee21a80ece386bb338131a606.jpg already downloaded
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_779e0fc9842b9009b17d54a349bbe6b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_779e0fc9842b9009b17d54a349bbe6b1.jpg already downloaded
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_66f95576d2c8717ba3a8142648491fe3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_66f95576d2c8717ba3a8142648491fe3.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_2968c73922e82116b4536a6f7d703f1b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_2968c73922e82116b4536a6f7d703f1b.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_6c6aa40be1ac165c3225f1bf3fc40bc3.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_6c6aa40be1ac165c3225f1bf3fc40bc3.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_d025fc22c5e16926a91cf05dd8efe1c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_d025fc22c5e16926a91cf05dd8efe1c8.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_f195ef441c8386c319dcbf33c37718e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_f195ef441c8386c319dcbf33c37718e0.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_c0303483844b1382bbea1536c660d937.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_c0303483844b1382bbea1536c660d937.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_de6ba8c56204e6af348ac0d3c5c10199.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_de6ba8c56204e6af348ac0d3c5c10199.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_0a66b75224ac9b6ec5f0e766edcd42c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_0a66b75224ac9b6ec5f0e766edcd42c8.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_081d8302e5a83960f6f38715cba9b024.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_081d8302e5a83960f6f38715cba9b024.jpg already downloaded
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Ffe%252Fcafea96d88720d7dfb9e31cadbdd08d5%252Fpa%252FTX56394_9dc5541c1c0e141082fad270b238e04a.png%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_9dc5541c1c0e141082fad270b238e04a.png already downloaded
2025-12-05 17:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be2360f9-2e64-578d-aa66-f15bd57cf342, identifier: TX56394
2025-12-05 17:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358072da-2b36-5526-9bf4-f2b10ff9367d with identifier: ZP73436
2025-12-05 17:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358072da-2b36-5526-9bf4-f2b10ff9367d with scrape type 2
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 358072da-2b36-5526-9bf4-f2b10ff9367d with scrape type 2
2025-12-05 17:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 358072da-2b36-5526-9bf4-f2b10ff9367d, identifier: ZP73436
2025-12-05 17:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_eddacbd470073b37aa8607fe8077d3dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_033af3dfb5ea8a9da7ae2059f355c336.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_033af3dfb5ea8a9da7ae2059f355c336.jpg not downloaded yet
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_c56bc08277067ececc629ac59d07a4dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_c56bc08277067ececc629ac59d07a4dc.jpg not downloaded yet
2025-12-05 17:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be2360f9-2e64-578d-aa66-f15bd57cf342 with identifier: TX56394
2025-12-05 17:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be2360f9-2e64-578d-aa66-f15bd57cf342 with identifier: TX56394
2025-12-05 17:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be2360f9-2e64-578d-aa66-f15bd57cf342 with identifier: TX56394 to the API
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX56394>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:07:34Z',
'fuel_type': 'petrol',
'id': 'be2360f9-2e64-578d-aa66-f15bd57cf342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX56394',
'listing': 'auction',
'location': 'FR, Le Boulou',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 36551,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_a0fff04d0a89b218e16ef7efa6106657.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_5138621dfec4a9e2580cae1c9f6f52cd.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_00ba207a7144456acbac6b9cf0d52c6b.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_fa608d83b94f051219684e4ad8e28f81.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_980e902ee21a80ece386bb338131a606.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_779e0fc9842b9009b17d54a349bbe6b1.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_66f95576d2c8717ba3a8142648491fe3.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_2968c73922e82116b4536a6f7d703f1b.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_6c6aa40be1ac165c3225f1bf3fc40bc3.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_d025fc22c5e16926a91cf05dd8efe1c8.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_f195ef441c8386c319dcbf33c37718e0.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_c0303483844b1382bbea1536c660d937.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_de6ba8c56204e6af348ac0d3c5c10199.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_0a66b75224ac9b6ec5f0e766edcd42c8.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_081d8302e5a83960f6f38715cba9b024.jpg',
'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_9dc5541c1c0e141082fad270b238e04a.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_a0fff04d0a89b218e16ef7efa6106657.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_5138621dfec4a9e2580cae1c9f6f52cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_00ba207a7144456acbac6b9cf0d52c6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_fa608d83b94f051219684e4ad8e28f81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_980e902ee21a80ece386bb338131a606.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_779e0fc9842b9009b17d54a349bbe6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_66f95576d2c8717ba3a8142648491fe3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_2968c73922e82116b4536a6f7d703f1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_6c6aa40be1ac165c3225f1bf3fc40bc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_d025fc22c5e16926a91cf05dd8efe1c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_f195ef441c8386c319dcbf33c37718e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2760083,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_c0303483844b1382bbea1536c660d937.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_de6ba8c56204e6af348ac0d3c5c10199.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_0a66b75224ac9b6ec5f0e766edcd42c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_081d8302e5a83960f6f38715cba9b024.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2360f9-2e64-578d-aa66-f15bd57cf342/be2360f9-2e64-578d-aa66-f15bd57cf342_image_15.png',
'Extension': 'png',
'FileSizeInBytes': 79732,
'Height': 525,
'OriginUrl': 'https://img-pa.auto1.com/imgca/fe/cafea96d88720d7dfb9e31cadbdd08d5/pa/TX56394_9dc5541c1c0e141082fad270b238e04a.png',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI ScoutLine',
'transmission': 'automatic',
'trim': 'ScoutLine',
'year': 2021}
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX56394%27 HTTP/1.1" 200 None
2025-12-05 17:13:05 [auto1.fr] INFO: Saving data for TX56394: {'created_time': 1764954785.804478, 'last_price_update_time': 1764954785.804493, 'auction_closing_time': 1765037254.0}
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX56394') HTTP/1.1" 204 0
2025-12-05 17:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 358072da-2b36-5526-9bf4-f2b10ff9367d with identifier: ZP73436
2025-12-05 17:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 358072da-2b36-5526-9bf4-f2b10ff9367d with identifier: ZP73436
2025-12-05 17:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 358072da-2b36-5526-9bf4-f2b10ff9367d with identifier: ZP73436 to the API
2025-12-05 17:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP73436>
{'auction_title': '',
'c_o_2_emission_value': 5,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 136,
'expiration_date': '2025-12-06T16:50:59Z',
'fuel_type': 'electro',
'id': '358072da-2b36-5526-9bf4-f2b10ff9367d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP73436',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 51395,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-21',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona electric drive 100 kW Executive 2WD',
'transmission': 'automatic',
'trim': 'Executive 2WD',
'year': 2022}
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP73436%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [auto1.fr] INFO: Saving data for ZP73436: {'auction_closing_time': 1765039859.0, 'created_time': 1763571964.948992, 'last_price_update_time': 1764954786.139114}
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP73436') HTTP/1.1" 204 0
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_cb63ab69ca65fede947ced70cd2dbeec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_8dc1d1398cb5f5b745904efebd1cdad2.png> (referer: https://www.auto1.com/)
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_754412ebe79f44cbb102fd49fef5da28.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_754412ebe79f44cbb102fd49fef5da28.jpg not downloaded yet
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_9057f298e5c54c1793ab6c80758f000c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_9057f298e5c54c1793ab6c80758f000c.jpg not downloaded yet
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM52507> (referer: https://www.auto1.com/v1/car-details-view/XM52507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC12795> (referer: https://www.auto1.com/v1/car-details-view/MC12795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US26255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU28181> (referer: https://www.auto1.com/v1/car-details-view/LU28181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d0b550>
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_eddacbd470073b37aa8607fe8077d3dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_eddacbd470073b37aa8607fe8077d3dc.jpg saved to cache
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_7d253bfe3a1417e08ebc4b003571dcb6.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_c239ce638d23764c5a9a6d608a348960.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_c239ce638d23764c5a9a6d608a348960.jpg not downloaded yet
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_9b33fb4b7968fe7e78ae4080ce9a058c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_9b33fb4b7968fe7e78ae4080ce9a058c.jpg not downloaded yet
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_14354abf4499e08e8efcc0dc37a72d99.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_14354abf4499e08e8efcc0dc37a72d99.jpg not downloaded yet
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_e9ca320e5ccbd791a35c40defb79daf9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_e9ca320e5ccbd791a35c40defb79daf9.jpg not downloaded yet
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a66850>
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_cb63ab69ca65fede947ced70cd2dbeec.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_cb63ab69ca65fede947ced70cd2dbeec.jpg saved to cache
2025-12-05 17:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:13:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:13:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2025-12-05 17:13:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fdd10>
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_2.png HTTP/1.1" 201 0
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_8dc1d1398cb5f5b745904efebd1cdad2.png') HTTP/1.1" 204 0
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_8dc1d1398cb5f5b745904efebd1cdad2.png saved to cache
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3343918c-700d-50f9-bbaf-8367aa2a1234 with identifier: XM52507
2025-12-05 17:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3343918c-700d-50f9-bbaf-8367aa2a1234 with scrape type 1
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_453cc44ee470a07d86e49ba7fadc937f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_453cc44ee470a07d86e49ba7fadc937f.jpg not downloaded yet
2025-12-05 17:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d127ff-81a3-5d2e-8abd-9e5b454884a1 with identifier: MC12795
2025-12-05 17:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d127ff-81a3-5d2e-8abd-9e5b454884a1 with scrape type 2
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d127ff-81a3-5d2e-8abd-9e5b454884a1 with scrape type 2
2025-12-05 17:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32d127ff-81a3-5d2e-8abd-9e5b454884a1, identifier: MC12795
2025-12-05 17:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec521880-7f41-556d-81bd-f8303aa002f3 with identifier: LU28181
2025-12-05 17:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec521880-7f41-556d-81bd-f8303aa002f3 with scrape type 1
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_b674b3ace356fe3c092df54071f9b8f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_b674b3ace356fe3c092df54071f9b8f4.jpg not downloaded yet
2025-12-05 17:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32d127ff-81a3-5d2e-8abd-9e5b454884a1 with identifier: MC12795
2025-12-05 17:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32d127ff-81a3-5d2e-8abd-9e5b454884a1 with identifier: MC12795
2025-12-05 17:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32d127ff-81a3-5d2e-8abd-9e5b454884a1 with identifier: MC12795 to the API
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MC12795>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': 'Taxi',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 230,
'expiration_date': '2025-12-06T16:53:17Z',
'fuel_type': 'hybrid',
'id': '32d127ff-81a3-5d2e-8abd-9e5b454884a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC12795',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 89887,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Business 2WD',
'transmission': 'automatic',
'trim': 'Business 2WD',
'year': 2021}
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC12795%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [auto1.fr] INFO: Saving data for MC12795: {'auction_closing_time': 1765039997.0, 'created_time': 1763460247.919039, 'last_price_update_time': 1764954787.479107}
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC12795') HTTP/1.1" 204 0
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_d64302c50dfc14ad430c817bef08da0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_d64302c50dfc14ad430c817bef08da0a.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_3599751d952a7cde7262641d915c0ea2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_3599751d952a7cde7262641d915c0ea2.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_c29900f871b03c186834c678b7e4b790.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_c29900f871b03c186834c678b7e4b790.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_265baca1653b5c71492fcb8d2c5569ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_265baca1653b5c71492fcb8d2c5569ec.jpg not downloaded yet
2025-12-05 17:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_70a02ffb3bc554df5d8ab9836fd60869.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL16810> (referer: https://www.auto1.com/v1/car-details-view/HL16810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_b6500a9d21d7de48293e78bbed20cc1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_b6500a9d21d7de48293e78bbed20cc1d.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_4886a0ab654b4090d3a374bb214b626c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_4886a0ab654b4090d3a374bb214b626c.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_6ec4b5103f4dac7ac9c6a0f96b57543b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_6ec4b5103f4dac7ac9c6a0f96b57543b.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_db388c5eba0a8c603727b196a7c931fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_db388c5eba0a8c603727b196a7c931fc.jpg not downloaded yet
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d36ad0>
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_7d253bfe3a1417e08ebc4b003571dcb6.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_7d253bfe3a1417e08ebc4b003571dcb6.jpg saved to cache
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_0698ff68baae855dfb5966f051b1126c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_0698ff68baae855dfb5966f051b1126c.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_dd6586ff8aa2f47179ba7b276c4b47ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_dd6586ff8aa2f47179ba7b276c4b47ef.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_fdfb87c9b67bca965f2d59d717fed065.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_fdfb87c9b67bca965f2d59d717fed065.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f688905c2f9136dc218ec106dd1095ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f688905c2f9136dc218ec106dd1095ee.jpg not downloaded yet
2025-12-05 17:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_02a373d16a372f0cde23cfeecdd6523c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:07 [scrapy.extensions.logstats] INFO: Crawled 904 pages (at 64 pages/min), scraped 213 items (at 13 items/min)
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_d6c87bade4baa903f2dd001f5075967c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_d6c87bade4baa903f2dd001f5075967c.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_709100572f5f0ce9b0551a540b9d195f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_709100572f5f0ce9b0551a540b9d195f.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_056ed827160db97c055b1d30f03d7ce1.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_056ed827160db97c055b1d30f03d7ce1.jpg not downloaded yet
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_643d88dd539211f54287f7f67f378b62.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_643d88dd539211f54287f7f67f378b62.jpg not downloaded yet
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e33110>
2025-12-05 17:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_70a02ffb3bc554df5d8ab9836fd60869.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_70a02ffb3bc554df5d8ab9836fd60869.jpg saved to cache
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e52a5ea8-70ee-5522-a5af-ed1970044e9d with identifier: HL16810
2025-12-05 17:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52a5ea8-70ee-5522-a5af-ed1970044e9d with scrape type 1
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_a9be61b798d48c5677b4bcc8763df93f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a9be61b798d48c5677b4bcc8763df93f.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_275414d747b619e72b347230f69ca5cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_275414d747b619e72b347230f69ca5cb.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_839784ee9ab9d6dd1a797ef4dd5444e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_839784ee9ab9d6dd1a797ef4dd5444e2.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_bff869ccbad863cfbeb78d92584a2650.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_bff869ccbad863cfbeb78d92584a2650.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f95389314aa2ee7607cc55e0c49aafd5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f95389314aa2ee7607cc55e0c49aafd5.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_05a7521010dd8a7df314024e922a1e85.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_05a7521010dd8a7df314024e922a1e85.jpg not downloaded yet
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7854750>
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_02a373d16a372f0cde23cfeecdd6523c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_02a373d16a372f0cde23cfeecdd6523c.jpg saved to cache
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_9df6911f1fedfad68747bfde108f8c7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_9df6911f1fedfad68747bfde108f8c7c.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_30ab038fcf60f4983c3468acc995d405.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_30ab038fcf60f4983c3468acc995d405.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_9db4d22e579f4e9f88fadc633f366b9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_9db4d22e579f4e9f88fadc633f366b9b.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_9bb40d1c2cb3c6a45a4e67356d7bfb7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_9bb40d1c2cb3c6a45a4e67356d7bfb7c.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_be5fb4a771514cfd6bf84d2d8526a1a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_be5fb4a771514cfd6bf84d2d8526a1a0.jpg not downloaded yet
2025-12-05 17:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_c56bc08277067ececc629ac59d07a4dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_54a6f904448e8b24bb893652948a3b93.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_54a6f904448e8b24bb893652948a3b93.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_fe8b227500271d85a831f90b0dba8bc4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_fe8b227500271d85a831f90b0dba8bc4.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_7268e3066f9018cbe72f7c5ebd94626a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_7268e3066f9018cbe72f7c5ebd94626a.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_88a19ae742c30aba80a9ff9a63546f9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_88a19ae742c30aba80a9ff9a63546f9c.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_cf12eb4ff519fe58ce00941fb06f50f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_cf12eb4ff519fe58ce00941fb06f50f4.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_930631d06ecf14073b0efc021598966b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_930631d06ecf14073b0efc021598966b.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_c65a28b5baa4fbc6e246a1c3650df251.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_c65a28b5baa4fbc6e246a1c3650df251.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_1124f18f87ae485138c5f63f1c6e9adb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_1124f18f87ae485138c5f63f1c6e9adb.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_68410cbe781f286fefb7e6507a16a5db.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_68410cbe781f286fefb7e6507a16a5db.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_0cacf5f5d04ae7382200f69bdf92e22d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0cacf5f5d04ae7382200f69bdf92e22d.jpg not downloaded yet
2025-12-05 17:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_491bc38778e3d36dae66edc17837695e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_6e7280be37d284403887d5ebe0b96d4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_6e7280be37d284403887d5ebe0b96d4d.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_4373707d1ad551aee9fb7a2e64ebf6fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_4373707d1ad551aee9fb7a2e64ebf6fa.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_1963a5c7354e360a3d2581837c1e3e8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_1963a5c7354e360a3d2581837c1e3e8b.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_6f38c1175352a98db848894550db4aba.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_6f38c1175352a98db848894550db4aba.jpg not downloaded yet
2025-12-05 17:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_bc7c8ea64e1b1fb86f7d1e6ac9e28c60.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bc7c8ea64e1b1fb86f7d1e6ac9e28c60.jpg not downloaded yet
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59fed90>
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_c56bc08277067ececc629ac59d07a4dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_c56bc08277067ececc629ac59d07a4dc.jpg saved to cache
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_fcf136c7cfe7bfe117c0e1a402242528.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_fcf136c7cfe7bfe117c0e1a402242528.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_393fa09e9a08de7884a630e07eccf93d.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_393fa09e9a08de7884a630e07eccf93d.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_10c55f6e174421335d1ec823db6a2760.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_10c55f6e174421335d1ec823db6a2760.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_a8d412c911162907ca15bf11d0a15b28.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_a8d412c911162907ca15bf11d0a15b28.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_0957d0f940671d383259d0c96754b96b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0957d0f940671d383259d0c96754b96b.jpg not downloaded yet
2025-12-05 17:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_033af3dfb5ea8a9da7ae2059f355c336.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_2f9f0f22cbdf210316447c6911cdc0d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_2f9f0f22cbdf210316447c6911cdc0d9.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f8128b8d063199a67dbacb9eb53eff68.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f8128b8d063199a67dbacb9eb53eff68.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_0925d8a881d33553c58f7f0ac03c761f.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0925d8a881d33553c58f7f0ac03c761f.jpg not downloaded yet
2025-12-05 17:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_023e6582f1f13665b2f9153d9015807b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_b2e8d09eb02353d0892938bebaae20a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_b2e8d09eb02353d0892938bebaae20a5.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_bd34f3e8f8d265feec878a5d873b4635.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_bd34f3e8f8d265feec878a5d873b4635.jpg not downloaded yet
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_e0f146f60ace18aeadd69206e8e9d0d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e0f146f60ace18aeadd69206e8e9d0d7.jpg not downloaded yet
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e646d0>
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F0b%252F9c0bea6e1dbf4934aac6d6b2638d7b0c%252Fpa%252FUT03578_491bc38778e3d36dae66edc17837695e.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_491bc38778e3d36dae66edc17837695e.jpg saved to cache
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf81e385-15d7-5549-9f65-e13bcaba8ea9
2025-12-05 17:13:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf81e385-15d7-5549-9f65-e13bcaba8ea9, skipping ID generation
2025-12-05 17:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf81e385-15d7-5549-9f65-e13bcaba8ea9 with scrape type 1
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bf81e385-15d7-5549-9f65-e13bcaba8ea9 from tracking dictionaries
2025-12-05 17:13:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf81e385-15d7-5549-9f65-e13bcaba8ea9 sending to next pipeline
2025-12-05 17:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf81e385-15d7-5549-9f65-e13bcaba8ea9, identifier: UT03578
2025-12-05 17:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf81e385-15d7-5549-9f65-e13bcaba8ea9 with identifier: UT03578
2025-12-05 17:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf81e385-15d7-5549-9f65-e13bcaba8ea9 with identifier: UT03578
2025-12-05 17:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf81e385-15d7-5549-9f65-e13bcaba8ea9 with identifier: UT03578 to the API
2025-12-05 17:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_491bc38778e3d36dae66edc17837695e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 224,
'expiration_date': '2025-12-06T16:31:26Z',
'fuel_type': 'hybrid',
'id': 'bf81e385-15d7-5549-9f65-e13bcaba8ea9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT03578',
'listing': 'auction',
'location': 'FR',
'make': 'Ford',
'model': 'Kuga',
'odometer': 73893,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 7,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1035739,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_781f7b7d8947e4a1c6a0ab4227296de8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1008467,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_90cd5cb9474e643bca2c88b722a45673.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 194928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_8dc1d1398cb5f5b745904efebd1cdad2.png',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1507899,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_491bc38778e3d36dae66edc17837695e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_eddacbd470073b37aa8607fe8077d3dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1028613,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a1f1725ce694fb05bea5b0c5cf0e99c7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf81e385-15d7-5549-9f65-e13bcaba8ea9/bf81e385-15d7-5549-9f65-e13bcaba8ea9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/0b/9c0bea6e1dbf4934aac6d6b2638d7b0c/pa/UT03578_a9d28a7e2a60cee3240f1e7e3965eeee.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2021}
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT03578%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [auto1.fr] INFO: Saving data for UT03578: {'created_time': 1764954790.21712, 'last_price_update_time': 1764954790.217132, 'auction_closing_time': 1765038686.0}
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT03578') HTTP/1.1" 204 0
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_f4c3d49ee0521be1e2af45292e2ef5ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_f4c3d49ee0521be1e2af45292e2ef5ed.jpg not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_089d931fa2e44b2968e3f569e6d547d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_089d931fa2e44b2968e3f569e6d547d2.jpg not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_341cef2df97f10d6db8548393d316f2b.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_341cef2df97f10d6db8548393d316f2b.jpg not downloaded yet
2025-12-05 17:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_8bb6cf047ec992fc18795a1532b66edd.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58284d0>
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_033af3dfb5ea8a9da7ae2059f355c336.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_033af3dfb5ea8a9da7ae2059f355c336.jpg saved to cache
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4eff1d0>
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_023e6582f1f13665b2f9153d9015807b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_023e6582f1f13665b2f9153d9015807b.jpg saved to cache
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_fdd8bbb0b9a1e5a1020d3b51be7df22f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_c0f9fad08b2b7341e95838d8deae415a.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_c0f9fad08b2b7341e95838d8deae415a.jpg not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_ffe957872e381bf742c1ccf6ced3f9f0.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_ffe957872e381bf742c1ccf6ced3f9f0.jpg not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_36c6fb2bd6cf898ba4cb885da16e5987.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_36c6fb2bd6cf898ba4cb885da16e5987.jpg not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_26300ec31ff0345e0c13a18f29905dd0.png%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_26300ec31ff0345e0c13a18f29905dd0.png not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f22254121b4fe1387105c001cf78adff.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f22254121b4fe1387105c001cf78adff.jpg not downloaded yet
2025-12-05 17:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_e5e111560c6525cb821ae7e168f56398.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e5e111560c6525cb821ae7e168f56398.jpg not downloaded yet
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_9057f298e5c54c1793ab6c80758f000c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_3549b26987881f3a6bf3b919f412d312.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_d92d129d9efcb45cfe6470a2d5fab9dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_d92d129d9efcb45cfe6470a2d5fab9dc.jpg not downloaded yet
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9f210>
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_8bb6cf047ec992fc18795a1532b66edd.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_8bb6cf047ec992fc18795a1532b66edd.jpg saved to cache
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_b674b3ace356fe3c092df54071f9b8f4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_fd2e47aa1f85177a2bafff693979a35e.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_fd2e47aa1f85177a2bafff693979a35e.jpg not downloaded yet
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58cdc10>
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_fdd8bbb0b9a1e5a1020d3b51be7df22f.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_fdd8bbb0b9a1e5a1020d3b51be7df22f.jpg saved to cache
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0cacf5f5d04ae7382200f69bdf92e22d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_f744ce6b7f3e1719d26df95611147225.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_f744ce6b7f3e1719d26df95611147225.jpg not downloaded yet
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_d6ab7c6cd36df0b1efef26cc55317705.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_265baca1653b5c71492fcb8d2c5569ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_be5fb4a771514cfd6bf84d2d8526a1a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d9d5d0>
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_9057f298e5c54c1793ab6c80758f000c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_9057f298e5c54c1793ab6c80758f000c.jpg saved to cache
2025-12-05 17:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e324d0>
2025-12-05 17:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg saved to cache
2025-12-05 17:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f14510>
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_1fa5d2e798e174782b2656439f8f35ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg saved to cache
2025-12-05 17:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a6550>
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_3549b26987881f3a6bf3b919f412d312.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_3549b26987881f3a6bf3b919f412d312.jpg saved to cache
2025-12-05 17:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4f1dd10>
2025-12-05 17:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_b674b3ace356fe3c092df54071f9b8f4.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_b674b3ace356fe3c092df54071f9b8f4.jpg saved to cache
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dfeed0>
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg saved to cache
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_b201393852bc7a0c6afc3d06c371cd22.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_b201393852bc7a0c6afc3d06c371cd22.jpg not downloaded yet
2025-12-05 17:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0957d0f940671d383259d0c96754b96b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0925d8a881d33553c58f7f0ac03c761f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_bacbcc9234d2c238d4ababbd24797dec.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bacbcc9234d2c238d4ababbd24797dec.jpg not downloaded yet
2025-12-05 17:13:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5774210>
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F6a%252Feb6a397b43d13fed168c1a4753c1d267%252Fpa%252FBU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg saved to cache
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8869283-35dd-5d13-aebb-0c57bc907496
2025-12-05 17:13:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8869283-35dd-5d13-aebb-0c57bc907496, skipping ID generation
2025-12-05 17:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8869283-35dd-5d13-aebb-0c57bc907496 with scrape type 1
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8869283-35dd-5d13-aebb-0c57bc907496 from tracking dictionaries
2025-12-05 17:13:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8869283-35dd-5d13-aebb-0c57bc907496 sending to next pipeline
2025-12-05 17:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8869283-35dd-5d13-aebb-0c57bc907496, identifier: BU62018
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d01650>
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_0cacf5f5d04ae7382200f69bdf92e22d.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0cacf5f5d04ae7382200f69bdf92e22d.jpg saved to cache
2025-12-05 17:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5aba110>
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5605537-9183-53b5-8431-161c89fc1ac7/f5605537-9183-53b5-8431-161c89fc1ac7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F92%252F5892314d45db3b09a38e5ddcb08c343c%252Fpa%252FJD81006_d6ab7c6cd36df0b1efef26cc55317705.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/92/5892314d45db3b09a38e5ddcb08c343c/pa/JD81006_d6ab7c6cd36df0b1efef26cc55317705.jpg saved to cache
2025-12-05 17:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5605537-9183-53b5-8431-161c89fc1ac7
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5967fd0>
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_265baca1653b5c71492fcb8d2c5569ec.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_265baca1653b5c71492fcb8d2c5569ec.jpg saved to cache
2025-12-05 17:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59700d0>
2025-12-05 17:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_be5fb4a771514cfd6bf84d2d8526a1a0.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_be5fb4a771514cfd6bf84d2d8526a1a0.jpg saved to cache
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8869283-35dd-5d13-aebb-0c57bc907496 with identifier: BU62018
2025-12-05 17:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8869283-35dd-5d13-aebb-0c57bc907496 with identifier: BU62018
2025-12-05 17:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 27037, 'odometer_reading_unit': 'km', 'registration_date': '2021-07-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu62018', 'expiration_date': '2025-12-06t16:20:39z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint herblain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': 'f8869283-35dd-5d13-aebb-0c57bc907496', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74202}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2608578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2685730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2443645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2621848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2659736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2513383}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2575483}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71952}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2831639}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2842646}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2857505}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65272}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2994347}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89821}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73587}], 'current_year_diff': 4, 'age_in_months': 52, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 27037}
Failed validating None in schema:
False
On instance:
{'age_in_months': 52,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:20:39z',
'fuel_type': 'petrol',
'id': 'f8869283-35dd-5d13-aebb-0c57bc907496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu62018',
'listing': 'auction',
'location': 'fr, saint herblain',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 27037,
'odometer_in_km': 27037,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2608578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685730,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443645,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621848,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659736,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2513383,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575483,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2831639,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2842646,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2857505,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2994347,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-26',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine pack',
'transmission': 'manual',
'trim': 'shine pack',
'year': 2021}
2025-12-05 17:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f8869283-35dd-5d13-aebb-0c57bc907496 spider: auto1.fr
2025-12-05 17:13:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f8869283-35dd-5d13-aebb-0c57bc907496 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 27037, 'odometer_reading_unit': 'km', 'registration_date': '2021-07-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu62018', 'expiration_date': '2025-12-06t16:20:39z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint herblain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': 'f8869283-35dd-5d13-aebb-0c57bc907496', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74202}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2608578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2685730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2443645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2621848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2659736}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2513383}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2575483}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71952}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2831639}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2842646}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2857505}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65272}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2994347}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89821}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73587}], 'current_year_diff': 4, 'age_in_months': 52, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 27037}
Failed validating None in schema:
False
On instance:
{'age_in_months': 52,
'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'emission_standard': 'euro 6',
'engine': '1.2l',
'engine_horse_power': 110,
'expiration_date': '2025-12-06t16:20:39z',
'fuel_type': 'petrol',
'id': 'f8869283-35dd-5d13-aebb-0c57bc907496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu62018',
'listing': 'auction',
'location': 'fr, saint herblain',
'make': 'citroen',
'make_model': 'citroen c3 aircross',
'model': 'c3 aircross',
'odometer': 27037,
'odometer_in_km': 27037,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2608578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685730,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443645,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621848,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659736,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2513383,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575483,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2831639,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2842646,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2857505,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2994347,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-26',
'sanitized_make': 'citroen',
'seats_number': 5,
'seller_name': None,
'title': 'citroen c3 aircross 1.2 puretech shine pack',
'transmission': 'manual',
'trim': 'shine pack',
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2025-12-06T16:20:39Z',
'fuel_type': 'petrol',
'id': 'f8869283-35dd-5d13-aebb-0c57bc907496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU62018',
'listing': 'auction',
'location': 'FR, Saint Herblain',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 27037,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d58086d75205177a641433afd0ab18e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2608578,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_0b72823d906125d7e487d74b0769e980.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685730,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d29bcdcbfaa96e3c968d0daed12ee150.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443645,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_1fa5d2e798e174782b2656439f8f35ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621848,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_e7d4aebbcdeb07038f7f511d3157f16c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659736,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7487e7971a41e574e2453efdebad2253.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2513383,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_d4692290310aca6f7cd228e3c2f6dec8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575483,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_6def34da9070b39701a2ba46d5389d70.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_7db4679f29bd00e669a8ebdfbc9fa10a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2831639,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_5610df7d1bfb6ad06749bbca05c4da72.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2842646,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_f30af5e1c1292dc7e94ba396c6f7fa0b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2857505,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_a2209f3b8425319bbdb77895a77ff317.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_59f3c13809b25a0b52c2aaf8f4fe9061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2994347,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8741055472170bbe2d51ecc3e5b1ce18.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_8ffb59e76c46132ad5ba3ab689565f7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8869283-35dd-5d13-aebb-0c57bc907496/f8869283-35dd-5d13-aebb-0c57bc907496_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/6a/eb6a397b43d13fed168c1a4753c1d267/pa/BU62018_900dd34045bd2b70d86680de1a2656cd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine Pack',
'transmission': 'manual',
'trim': 'Shine Pack',
'year': 2021}
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU62018%27 HTTP/1.1" 200 None
2025-12-05 17:13:15 [auto1.fr] INFO: Saving data for BU62018: {'created_time': 1764954795.309246, 'last_price_update_time': 1764954795.309255, 'auction_closing_time': 1765038039.0}
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU62018') HTTP/1.1" 204 0
2025-12-05 17:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e0f146f60ace18aeadd69206e8e9d0d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_341cef2df97f10d6db8548393d316f2b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_a025da6cdc7a225e612b15976b989846.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a025da6cdc7a225e612b15976b989846.jpg not downloaded yet
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_8dc5b0aa27dbd86a107daea5520e58eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_8dc5b0aa27dbd86a107daea5520e58eb.jpg not downloaded yet
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c788f3d0>
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_0957d0f940671d383259d0c96754b96b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0957d0f940671d383259d0c96754b96b.jpg saved to cache
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58901d0>
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_0925d8a881d33553c58f7f0ac03c761f.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0925d8a881d33553c58f7f0ac03c761f.jpg saved to cache
2025-12-05 17:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58deed0>
2025-12-05 17:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_e0f146f60ace18aeadd69206e8e9d0d7.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e0f146f60ace18aeadd69206e8e9d0d7.jpg saved to cache
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cb77d0>
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_341cef2df97f10d6db8548393d316f2b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_341cef2df97f10d6db8548393d316f2b.jpg saved to cache
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_b201393852bc7a0c6afc3d06c371cd22.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f22254121b4fe1387105c001cf78adff.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bacbcc9234d2c238d4ababbd24797dec.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_f744ce6b7f3e1719d26df95611147225.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_fd2e47aa1f85177a2bafff693979a35e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e5e111560c6525cb821ae7e168f56398.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_d92d129d9efcb45cfe6470a2d5fab9dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f688905c2f9136dc218ec106dd1095ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_26300ec31ff0345e0c13a18f29905dd0.png> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_089d931fa2e44b2968e3f569e6d547d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_bd34f3e8f8d265feec878a5d873b4635.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_c0f9fad08b2b7341e95838d8deae415a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_b2e8d09eb02353d0892938bebaae20a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_8dc5b0aa27dbd86a107daea5520e58eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_ffe957872e381bf742c1ccf6ced3f9f0.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f8128b8d063199a67dbacb9eb53eff68.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a025da6cdc7a225e612b15976b989846.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a724d0>
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_b201393852bc7a0c6afc3d06c371cd22.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_b201393852bc7a0c6afc3d06c371cd22.jpg saved to cache
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5b30dd0>
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f22254121b4fe1387105c001cf78adff.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f22254121b4fe1387105c001cf78adff.jpg saved to cache
2025-12-05 17:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_fcf136c7cfe7bfe117c0e1a402242528.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bc7c8ea64e1b1fb86f7d1e6ac9e28c60.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_10c55f6e174421335d1ec823db6a2760.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_393fa09e9a08de7884a630e07eccf93d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_36c6fb2bd6cf898ba4cb885da16e5987.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b74a50>
2025-12-05 17:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_16.jpg HTTP/1.1" 201 0
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_bacbcc9234d2c238d4ababbd24797dec.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bacbcc9234d2c238d4ababbd24797dec.jpg saved to cache
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b745d0>
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_f744ce6b7f3e1719d26df95611147225.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_f744ce6b7f3e1719d26df95611147225.jpg saved to cache
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bfbc10>
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_fd2e47aa1f85177a2bafff693979a35e.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_fd2e47aa1f85177a2bafff693979a35e.jpg saved to cache
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bfd350>
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_e5e111560c6525cb821ae7e168f56398.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e5e111560c6525cb821ae7e168f56398.jpg saved to cache
2025-12-05 17:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b7ed50>
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_d92d129d9efcb45cfe6470a2d5fab9dc.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_d92d129d9efcb45cfe6470a2d5fab9dc.jpg saved to cache
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c03510>
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f688905c2f9136dc218ec106dd1095ee.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f688905c2f9136dc218ec106dd1095ee.jpg saved to cache
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:13:18 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:13:18 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:13:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c0b910>
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_15.png HTTP/1.1" 201 0
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_26300ec31ff0345e0c13a18f29905dd0.png') HTTP/1.1" 204 0
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_26300ec31ff0345e0c13a18f29905dd0.png saved to cache
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c0d0d0>
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_089d931fa2e44b2968e3f569e6d547d2.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_089d931fa2e44b2968e3f569e6d547d2.jpg saved to cache
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c11f90>
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_bd34f3e8f8d265feec878a5d873b4635.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_bd34f3e8f8d265feec878a5d873b4635.jpg saved to cache
2025-12-05 17:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c16890>
2025-12-05 17:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_c0f9fad08b2b7341e95838d8deae415a.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_c0f9fad08b2b7341e95838d8deae415a.jpg saved to cache
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c1e710>
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_b2e8d09eb02353d0892938bebaae20a5.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_b2e8d09eb02353d0892938bebaae20a5.jpg saved to cache
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c28fd0>
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_18.jpg HTTP/1.1" 201 0
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_8dc5b0aa27dbd86a107daea5520e58eb.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_8dc5b0aa27dbd86a107daea5520e58eb.jpg saved to cache
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c32650>
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_ffe957872e381bf742c1ccf6ced3f9f0.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_ffe957872e381bf742c1ccf6ced3f9f0.jpg saved to cache
2025-12-05 17:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4bb9fd0>
2025-12-05 17:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f8128b8d063199a67dbacb9eb53eff68.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f8128b8d063199a67dbacb9eb53eff68.jpg saved to cache
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c14710>
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_17.jpg HTTP/1.1" 201 0
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_a025da6cdc7a225e612b15976b989846.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a025da6cdc7a225e612b15976b989846.jpg saved to cache
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e490d0>
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_fcf136c7cfe7bfe117c0e1a402242528.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_fcf136c7cfe7bfe117c0e1a402242528.jpg saved to cache
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d45e90>
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_bc7c8ea64e1b1fb86f7d1e6ac9e28c60.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bc7c8ea64e1b1fb86f7d1e6ac9e28c60.jpg saved to cache
2025-12-05 17:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5906d90>
2025-12-05 17:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_10c55f6e174421335d1ec823db6a2760.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_10c55f6e174421335d1ec823db6a2760.jpg saved to cache
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c3f050>
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_15.jpg HTTP/1.1" 201 0
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_393fa09e9a08de7884a630e07eccf93d.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_393fa09e9a08de7884a630e07eccf93d.jpg saved to cache
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d45810>
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_36c6fb2bd6cf898ba4cb885da16e5987.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_36c6fb2bd6cf898ba4cb885da16e5987.jpg saved to cache
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_1963a5c7354e360a3d2581837c1e3e8b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_4373707d1ad551aee9fb7a2e64ebf6fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_6e7280be37d284403887d5ebe0b96d4d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_f4c3d49ee0521be1e2af45292e2ef5ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_a8d412c911162907ca15bf11d0a15b28.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_2f9f0f22cbdf210316447c6911cdc0d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_6f38c1175352a98db848894550db4aba.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_68410cbe781f286fefb7e6507a16a5db.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_c65a28b5baa4fbc6e246a1c3650df251.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_1124f18f87ae485138c5f63f1c6e9adb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_fe8b227500271d85a831f90b0dba8bc4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_54a6f904448e8b24bb893652948a3b93.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_9bb40d1c2cb3c6a45a4e67356d7bfb7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_cf12eb4ff519fe58ce00941fb06f50f4.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a94bd0>
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_1963a5c7354e360a3d2581837c1e3e8b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_1963a5c7354e360a3d2581837c1e3e8b.jpg saved to cache
2025-12-05 17:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_9db4d22e579f4e9f88fadc633f366b9b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c9a290>
2025-12-05 17:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_4373707d1ad551aee9fb7a2e64ebf6fa.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_4373707d1ad551aee9fb7a2e64ebf6fa.jpg saved to cache
2025-12-05 17:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5878cd0>
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_14.jpg HTTP/1.1" 201 0
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_6e7280be37d284403887d5ebe0b96d4d.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_6e7280be37d284403887d5ebe0b96d4d.jpg saved to cache
2025-12-05 17:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5909e90>
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_f4c3d49ee0521be1e2af45292e2ef5ed.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_f4c3d49ee0521be1e2af45292e2ef5ed.jpg saved to cache
2025-12-05 17:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e37110>
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_a8d412c911162907ca15bf11d0a15b28.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_a8d412c911162907ca15bf11d0a15b28.jpg saved to cache
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d34bd0>
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_2f9f0f22cbdf210316447c6911cdc0d9.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_2f9f0f22cbdf210316447c6911cdc0d9.jpg saved to cache
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4dc4850>
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_6f38c1175352a98db848894550db4aba.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_6f38c1175352a98db848894550db4aba.jpg saved to cache
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a96ed0>
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_68410cbe781f286fefb7e6507a16a5db.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_68410cbe781f286fefb7e6507a16a5db.jpg saved to cache
2025-12-05 17:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e37e90>
2025-12-05 17:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_c65a28b5baa4fbc6e246a1c3650df251.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_c65a28b5baa4fbc6e246a1c3650df251.jpg saved to cache
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f0950>
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_1124f18f87ae485138c5f63f1c6e9adb.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_1124f18f87ae485138c5f63f1c6e9adb.jpg saved to cache
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5899510>
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_fe8b227500271d85a831f90b0dba8bc4.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_fe8b227500271d85a831f90b0dba8bc4.jpg saved to cache
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d7f7d0>
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_54a6f904448e8b24bb893652948a3b93.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_54a6f904448e8b24bb893652948a3b93.jpg saved to cache
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d21290>
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_9bb40d1c2cb3c6a45a4e67356d7bfb7c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_9bb40d1c2cb3c6a45a4e67356d7bfb7c.jpg saved to cache
2025-12-05 17:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59f3810>
2025-12-05 17:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_cf12eb4ff519fe58ce00941fb06f50f4.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_cf12eb4ff519fe58ce00941fb06f50f4.jpg saved to cache
2025-12-05 17:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57ece90>
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_9db4d22e579f4e9f88fadc633f366b9b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_9db4d22e579f4e9f88fadc633f366b9b.jpg saved to cache
2025-12-05 17:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_930631d06ecf14073b0efc021598966b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_88a19ae742c30aba80a9ff9a63546f9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_30ab038fcf60f4983c3468acc995d405.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_7268e3066f9018cbe72f7c5ebd94626a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_9df6911f1fedfad68747bfde108f8c7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_bff869ccbad863cfbeb78d92584a2650.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_05a7521010dd8a7df314024e922a1e85.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a9be61b798d48c5677b4bcc8763df93f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_709100572f5f0ce9b0551a540b9d195f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_d6c87bade4baa903f2dd001f5075967c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e2d3d0>
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_13.jpg HTTP/1.1" 201 0
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_930631d06ecf14073b0efc021598966b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_930631d06ecf14073b0efc021598966b.jpg saved to cache
2025-12-05 17:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd4fd0>
2025-12-05 17:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_88a19ae742c30aba80a9ff9a63546f9c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_88a19ae742c30aba80a9ff9a63546f9c.jpg saved to cache
2025-12-05 17:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d95790>
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_30ab038fcf60f4983c3468acc995d405.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_30ab038fcf60f4983c3468acc995d405.jpg saved to cache
2025-12-05 17:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c59252d0>
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_7268e3066f9018cbe72f7c5ebd94626a.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_7268e3066f9018cbe72f7c5ebd94626a.jpg saved to cache
2025-12-05 17:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c578ea90>
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_11.jpg HTTP/1.1" 201 0
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_9df6911f1fedfad68747bfde108f8c7c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_9df6911f1fedfad68747bfde108f8c7c.jpg saved to cache
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58065d0>
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_bff869ccbad863cfbeb78d92584a2650.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_bff869ccbad863cfbeb78d92584a2650.jpg saved to cache
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5804850>
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_05a7521010dd8a7df314024e922a1e85.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_05a7521010dd8a7df314024e922a1e85.jpg saved to cache
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4cd5690>
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F2d%252F7b2df8fd2c144b811828a6ce91d20952%252Fpa%252FHL16810_a9be61b798d48c5677b4bcc8763df93f.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a9be61b798d48c5677b4bcc8763df93f.jpg saved to cache
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e52a5ea8-70ee-5522-a5af-ed1970044e9d
2025-12-05 17:13:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e52a5ea8-70ee-5522-a5af-ed1970044e9d, skipping ID generation
2025-12-05 17:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52a5ea8-70ee-5522-a5af-ed1970044e9d with scrape type 1
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e52a5ea8-70ee-5522-a5af-ed1970044e9d from tracking dictionaries
2025-12-05 17:13:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e52a5ea8-70ee-5522-a5af-ed1970044e9d sending to next pipeline
2025-12-05 17:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e52a5ea8-70ee-5522-a5af-ed1970044e9d, identifier: HL16810
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d25690>
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_709100572f5f0ce9b0551a540b9d195f.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_709100572f5f0ce9b0551a540b9d195f.jpg saved to cache
2025-12-05 17:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ecdb90>
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_9.jpg HTTP/1.1" 201 0
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_d6c87bade4baa903f2dd001f5075967c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_d6c87bade4baa903f2dd001f5075967c.jpg saved to cache
2025-12-05 17:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e52a5ea8-70ee-5522-a5af-ed1970044e9d with identifier: HL16810
2025-12-05 17:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e52a5ea8-70ee-5522-a5af-ed1970044e9d with identifier: HL16810
2025-12-05 17:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e52a5ea8-70ee-5522-a5af-ed1970044e9d with identifier: HL16810 to the API
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 17:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 17:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a9be61b798d48c5677b4bcc8763df93f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2025-12-06T16:39:50Z',
'fuel_type': 'petrol',
'id': 'e52a5ea8-70ee-5522-a5af-ed1970044e9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL16810',
'listing': 'auction',
'location': 'FR',
'make': 'Peugeot',
'model': '208',
'odometer': 97649,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a9be61b798d48c5677b4bcc8763df93f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_05a7521010dd8a7df314024e922a1e85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_be5fb4a771514cfd6bf84d2d8526a1a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_cf12eb4ff519fe58ce00941fb06f50f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0cacf5f5d04ae7382200f69bdf92e22d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bc7c8ea64e1b1fb86f7d1e6ac9e28c60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0957d0f940671d383259d0c96754b96b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_0925d8a881d33553c58f7f0ac03c761f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e0f146f60ace18aeadd69206e8e9d0d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_341cef2df97f10d6db8548393d316f2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_36c6fb2bd6cf898ba4cb885da16e5987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_e5e111560c6525cb821ae7e168f56398.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_d92d129d9efcb45cfe6470a2d5fab9dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_fd2e47aa1f85177a2bafff693979a35e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_f744ce6b7f3e1719d26df95611147225.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_b201393852bc7a0c6afc3d06c371cd22.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_bacbcc9234d2c238d4ababbd24797dec.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_a025da6cdc7a225e612b15976b989846.jpg',
'Width': 270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52a5ea8-70ee-5522-a5af-ed1970044e9d/e52a5ea8-70ee-5522-a5af-ed1970044e9d_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/2d/7b2df8fd2c144b811828a6ce91d20952/pa/HL16810_8dc5b0aa27dbd86a107daea5520e58eb.jpg',
'Width': 270}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2016}
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL16810%27 HTTP/1.1" 200 None
2025-12-05 17:13:29 [auto1.fr] INFO: Saving data for HL16810: {'created_time': 1764954809.093825, 'last_price_update_time': 1764954809.093836, 'auction_closing_time': 1765039190.0}
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL16810') HTTP/1.1" 204 0
2025-12-05 17:13:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f95389314aa2ee7607cc55e0c49aafd5.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_643d88dd539211f54287f7f67f378b62.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_839784ee9ab9d6dd1a797ef4dd5444e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_056ed827160db97c055b1d30f03d7ce1.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_275414d747b619e72b347230f69ca5cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_fdfb87c9b67bca965f2d59d717fed065.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_0698ff68baae855dfb5966f051b1126c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_dd6586ff8aa2f47179ba7b276c4b47ef.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_453cc44ee470a07d86e49ba7fadc937f.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5879a90>
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_f95389314aa2ee7607cc55e0c49aafd5.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f95389314aa2ee7607cc55e0c49aafd5.jpg saved to cache
2025-12-05 17:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_d64302c50dfc14ad430c817bef08da0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b781d0>
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_643d88dd539211f54287f7f67f378b62.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_643d88dd539211f54287f7f67f378b62.jpg saved to cache
2025-12-05 17:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4c913d0>
2025-12-05 17:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_839784ee9ab9d6dd1a797ef4dd5444e2.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_839784ee9ab9d6dd1a797ef4dd5444e2.jpg saved to cache
2025-12-05 17:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58a5690>
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_056ed827160db97c055b1d30f03d7ce1.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_056ed827160db97c055b1d30f03d7ce1.jpg saved to cache
2025-12-05 17:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c7cdd7d0>
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_10.jpg HTTP/1.1" 201 0
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_275414d747b619e72b347230f69ca5cb.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_275414d747b619e72b347230f69ca5cb.jpg saved to cache
2025-12-05 17:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c57e7110>
2025-12-05 17:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_fdfb87c9b67bca965f2d59d717fed065.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_fdfb87c9b67bca965f2d59d717fed065.jpg saved to cache
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5abab90>
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_0698ff68baae855dfb5966f051b1126c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_0698ff68baae855dfb5966f051b1126c.jpg saved to cache
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4ef6910>
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_8.jpg HTTP/1.1" 201 0
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_dd6586ff8aa2f47179ba7b276c4b47ef.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_dd6586ff8aa2f47179ba7b276c4b47ef.jpg saved to cache
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5914610>
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_0.jpg HTTP/1.1" 201 0
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_453cc44ee470a07d86e49ba7fadc937f.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_453cc44ee470a07d86e49ba7fadc937f.jpg saved to cache
2025-12-05 17:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_e9ca320e5ccbd791a35c40defb79daf9.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5899910>
2025-12-05 17:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_d64302c50dfc14ad430c817bef08da0a.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_d64302c50dfc14ad430c817bef08da0a.jpg saved to cache
2025-12-05 17:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5ab8390>
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_e9ca320e5ccbd791a35c40defb79daf9.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_e9ca320e5ccbd791a35c40defb79daf9.jpg saved to cache
2025-12-05 17:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_9b33fb4b7968fe7e78ae4080ce9a058c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_14354abf4499e08e8efcc0dc37a72d99.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_3599751d952a7cde7262641d915c0ea2.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_db388c5eba0a8c603727b196a7c931fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_4886a0ab654b4090d3a374bb214b626c.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_754412ebe79f44cbb102fd49fef5da28.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_6ec4b5103f4dac7ac9c6a0f96b57543b.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_b6500a9d21d7de48293e78bbed20cc1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_c29900f871b03c186834c678b7e4b790.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_09f3fc0780799b4460e0566d5e43021a.png> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_06cf945f4576805096ebf16a3862475e.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US26255> (referer: https://www.auto1.com/v1/car-details-view/US26255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c594ce50>
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_4.jpg HTTP/1.1" 201 0
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_9b33fb4b7968fe7e78ae4080ce9a058c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_9b33fb4b7968fe7e78ae4080ce9a058c.jpg saved to cache
2025-12-05 17:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_19d2429fc6811c9151511ff2c8e97a81.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_c239ce638d23764c5a9a6d608a348960.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_86a4f4e90343b6b1d6f65b1448a7adb7.jpg> (referer: https://www.auto1.com/)
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5990dd0>
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_5.jpg HTTP/1.1" 201 0
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_14354abf4499e08e8efcc0dc37a72d99.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_14354abf4499e08e8efcc0dc37a72d99.jpg saved to cache
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c585e6d0>
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_6.jpg HTTP/1.1" 201 0
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_3599751d952a7cde7262641d915c0ea2.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_3599751d952a7cde7262641d915c0ea2.jpg saved to cache
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58e7a10>
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8a%252Fe78a923abaab75c1db56c63306252fae%252Fpa%252FLU28181_db388c5eba0a8c603727b196a7c931fc.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_db388c5eba0a8c603727b196a7c931fc.jpg saved to cache
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec521880-7f41-556d-81bd-f8303aa002f3
2025-12-05 17:13:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec521880-7f41-556d-81bd-f8303aa002f3, skipping ID generation
2025-12-05 17:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec521880-7f41-556d-81bd-f8303aa002f3 with scrape type 1
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ec521880-7f41-556d-81bd-f8303aa002f3 from tracking dictionaries
2025-12-05 17:13:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec521880-7f41-556d-81bd-f8303aa002f3 sending to next pipeline
2025-12-05 17:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec521880-7f41-556d-81bd-f8303aa002f3, identifier: LU28181
2025-12-05 17:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5a4f550>
2025-12-05 17:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3821b69f-fe87-5c77-8274-0af1813546b6/3821b69f-fe87-5c77-8274-0af1813546b6_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fce%252Fc2ce2686b9454545a3444ef60467f6ac%252Fpa%252FSR88466_4886a0ab654b4090d3a374bb214b626c.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ce/c2ce2686b9454545a3444ef60467f6ac/pa/SR88466_4886a0ab654b4090d3a374bb214b626c.jpg saved to cache
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3821b69f-fe87-5c77-8274-0af1813546b6
2025-12-05 17:13:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3821b69f-fe87-5c77-8274-0af1813546b6, skipping ID generation
2025-12-05 17:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3821b69f-fe87-5c77-8274-0af1813546b6 with scrape type 1
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3821b69f-fe87-5c77-8274-0af1813546b6 from tracking dictionaries
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3821b69f-fe87-5c77-8274-0af1813546b6 sending to next pipeline
2025-12-05 17:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3821b69f-fe87-5c77-8274-0af1813546b6, identifier: SR88466
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4d13fd0>
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_3.jpg HTTP/1.1" 201 0
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_754412ebe79f44cbb102fd49fef5da28.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_754412ebe79f44cbb102fd49fef5da28.jpg saved to cache
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c5851e50>
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_2.jpg HTTP/1.1" 201 0
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_6ec4b5103f4dac7ac9c6a0f96b57543b.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_6ec4b5103f4dac7ac9c6a0f96b57543b.jpg saved to cache
2025-12-05 17:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c593fa10>
2025-12-05 17:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8564a471-2b92-56d6-b0e4-98397603e979/8564a471-2b92-56d6-b0e4-98397603e979_image_7.jpg HTTP/1.1" 201 0
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F31%252Fd431f70e70b3c66767b7485cd63d166e%252Fpa%252FMX72651_b6500a9d21d7de48293e78bbed20cc1d.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/31/d431f70e70b3c66767b7485cd63d166e/pa/MX72651_b6500a9d21d7de48293e78bbed20cc1d.jpg saved to cache
2025-12-05 17:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8564a471-2b92-56d6-b0e4-98397603e979
2025-12-05 17:13:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4e6abd0>
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3343918c-700d-50f9-bbaf-8367aa2a1234/3343918c-700d-50f9-bbaf-8367aa2a1234_image_1.jpg HTTP/1.1" 201 0
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F7d%252F737df76f1b3bdd368cc1060be922341b%252Fpa%252FXM52507_c29900f871b03c186834c678b7e4b790.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/7d/737df76f1b3bdd368cc1060be922341b/pa/XM52507_c29900f871b03c186834c678b7e4b790.jpg saved to cache
2025-12-05 17:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3343918c-700d-50f9-bbaf-8367aa2a1234
2025-12-05 17:13:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3343918c-700d-50f9-bbaf-8367aa2a1234, skipping ID generation
2025-12-05 17:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3343918c-700d-50f9-bbaf-8367aa2a1234 with scrape type 1
2025-12-05 17:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3343918c-700d-50f9-bbaf-8367aa2a1234 from tracking dictionaries
2025-12-05 17:13:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3343918c-700d-50f9-bbaf-8367aa2a1234 sending to next pipeline
2025-12-05 17:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3343918c-700d-50f9-bbaf-8367aa2a1234, identifier: XM52507
2025-12-05 17:13:35 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 17:13:35 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2025-12-05 17:13:35 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2025-12-05 17:13:35 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c4b7a0d0>
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a/5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a_image_15.png HTTP/1.1" 201 0
2025-12-05 17:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_09f3fc0780799b4460e0566d5e43021a.png') HTTP/1.1" 204 0
2025-12-05 17:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_09f3fc0780799b4460e0566d5e43021a.png saved to cache
2025-12-05 17:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a
2025-12-05 17:13:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 17:13:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 17:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 17:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f71c58830d0>
2025-12-05 17:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 17:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a/5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 17:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F83%252Fea83f0af6b725b94e425ce1de562dd6b%252Fpa%252FUN83109_06cf945f4576805096ebf16a3862475e.jpg') HTTP/1.1" 204 0
2025-12-05 17:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/83/ea83f0af6b725b94e425ce1de562dd6b/pa/UN83109_06cf945f4576805096ebf16a3862475e.jpg saved to cache
2025-12-05 17:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5e99e6ff-a47a-50fe-8729-d6ec0eb7e57a
2025-12-05 17:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90acdbff-3342-5f86-8185-c51b850073c1 with identifier: US26255
2025-12-05 17:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90acdbff-3342-5f86-8185-c51b850073c1 with scrape type 2
2025-12-05 17:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90acdbff-3342-5f86-8185-c51b850073c1 with scrape type 2
2025-12-05 17:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 90acdbff-3342-5f86-8185-c51b850073c1, identifier: US26255
2025-12-05 17:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec521880-7f41-556d-81bd-f8303aa002f3 with identifier: LU28181
2025-12-05 17:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec521880-7f41-556d-81bd-f8303aa002f3 with identifier: LU28181
2025-12-05 17:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 196383 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
196383
2025-12-05 17:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec521880-7f41-556d-81bd-f8303aa002f3 spider: auto1.fr
2025-12-05 17:13:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ec521880-7f41-556d-81bd-f8303aa002f3 due to rule: high_mileage_for_country.json, error: 196383 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
196383
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2025-12-06T16:36:37Z',
'fuel_type': 'diesel',
'id': 'ec521880-7f41-556d-81bd-f8303aa002f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU28181',
'listing': 'auction',
'location': 'FR, Pornichet',
'make': 'Renault',
'model': 'Megane',
'odometer': 196383,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_b674b3ace356fe3c092df54071f9b8f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_265baca1653b5c71492fcb8d2c5569ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2236993,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_db388c5eba0a8c603727b196a7c931fc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2227438,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f688905c2f9136dc218ec106dd1095ee.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2132150,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_643d88dd539211f54287f7f67f378b62.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2302951,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f95389314aa2ee7607cc55e0c49aafd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_9bb40d1c2cb3c6a45a4e67356d7bfb7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2420186,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_88a19ae742c30aba80a9ff9a63546f9c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2992292,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_68410cbe781f286fefb7e6507a16a5db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2459636,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_6f38c1175352a98db848894550db4aba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2350962,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_a8d412c911162907ca15bf11d0a15b28.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_f8128b8d063199a67dbacb9eb53eff68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_bd34f3e8f8d265feec878a5d873b4635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec521880-7f41-556d-81bd-f8303aa002f3/ec521880-7f41-556d-81bd-f8303aa002f3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8a/e78a923abaab75c1db56c63306252fae/pa/LU28181_089d931fa2e44b2968e3f569e6d547d2.jpg',
'Width': 800},
{'BlobStorageUrl': '